-- Logs begin at Fri 2022-05-13 12:29:39 UTC, end at Fri 2022-05-13 13:43:08 UTC. -- May 13 13:15:49.282830 dv-cinder-841591-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 13:15:49.296009 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 13:15:49 2022] *** May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: nodename: dv-cinder-841591-2-iscsi May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: machine: x86_64 May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: clock source: unix May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: pcre jit disabled May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: detected number of CPU cores: 4 May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: current working directory: / May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: detected binary path: /usr/bin/uwsgi-core May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: your processes number limit is 47680 May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: your memory page size is 4096 bytes May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: detected max file descriptor number: 2048 May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: lock engine: pthread robust mutexes May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: thunder lock: enabled May 13 13:15:49.296553 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 13:15:49.297485 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 13:15:49.342090 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: Python main interpreter initialized at 0x55c45805f9c0 May 13 13:15:49.342090 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: python threads support enabled May 13 13:15:49.342090 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: your server socket listen backlog is limited to 100 connections May 13 13:15:49.342090 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: your mercy for graceful operations on workers is 90 seconds May 13 13:15:49.342485 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: mapped 403077 bytes (393 KB) for 2 cores May 13 13:15:49.342485 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: *** Operational MODE: preforking *** May 13 13:15:49.342764 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: *** uWSGI is running in multiple interpreter mode *** May 13 13:15:49.342764 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: spawned uWSGI master process (pid: 103236) May 13 13:15:49.342969 dv-cinder-841591-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 13:15:49.343570 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: spawned uWSGI worker 1 (pid: 103237, cores: 1) May 13 13:15:49.343926 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: spawned uWSGI worker 2 (pid: 103238, cores: 1) May 13 13:15:49.344085 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 13:15:50.538566 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:15:50.546314 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:15:51.271681 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:15:51.271681 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: from cryptography.utils import int_from_bytes May 13 13:15:51.272005 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:15:51.272005 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: from cryptography.utils import int_from_bytes May 13 13:15:51.277111 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:15:51.277111 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: from cryptography.utils import int_from_bytes May 13 13:15:51.277432 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:15:51.277432 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: from cryptography.utils import int_from_bytes May 13 13:15:53.921347 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:15:53.921912 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:15:53.922064 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:15:53.922429 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:15:53.922684 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:15:53.922887 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:15:53.923312 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.923404 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:15:53.923490 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.923674 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:15:53.923796 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.923994 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.924086 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:15:53.924285 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:15:53.924382 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.924619 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.924722 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.924940 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.925032 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.925260 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.925349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.925588 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.925692 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.925871 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.925979 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.926185 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.926279 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.926509 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841591-2-iscsi {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.926606 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.926831 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.926937 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.927139 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.927237 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.927454 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.927547 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.927775 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.927875 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.928075 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.928170 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841591-2-iscsi {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.928396 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.928482 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.928699 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.928792 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.929017 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.929193 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.929344 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.929659 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.929779 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.929988 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.930100 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.930301 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.930401 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.930637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.930830 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.930964 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.931138 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.931233 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.931450 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.931551 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.931768 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.931871 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.932112 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.932205 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.932432 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.932514 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.932748 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.932844 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841591-2-iscsi {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.933076 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.933233 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.933393 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.933502 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.933723 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.933831 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.934070 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.934212 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.934459 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.934550 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841591-2-iscsi {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.934768 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.934872 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.935087 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.935185 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.935407 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.935498 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.935715 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.935829 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.936042 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.936134 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.936362 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.936448 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.936679 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.936775 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.936997 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.937096 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.937298 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.937383 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.937609 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.937702 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.937941 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.938039 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.938261 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.938349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.938566 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.938653 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.938868 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.938963 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.939119 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.939255 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.939426 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.939569 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.939745 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.939897 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.940065 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.940211 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.940385 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.940521 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.940639 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.940783 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.940901 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.941107 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.941209 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.941437 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.941541 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.941764 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.941898 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.942110 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.942215 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.942368 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.942476 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.942626 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.942722 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.942953 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.943047 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.943535 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.943631 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.943837 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.943930 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.944270 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.944371 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.944451 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.944528 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.944756 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.944854 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.945069 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.945168 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.945399 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.945485 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.945711 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.945812 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.946053 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.946140 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.946372 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.946466 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.946681 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.946817 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.947010 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.947095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.947326 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.947422 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.947633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.947725 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.947952 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.948044 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.948271 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.948365 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.948578 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.948664 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.948883 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.948975 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.949188 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.949299 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.949505 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.949592 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.949848 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.949951 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.950157 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.950253 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.950409 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.950496 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.950711 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.950797 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.951017 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.951114 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.951333 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.951431 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.951638 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.951725 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.951943 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.952030 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.952249 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.952336 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.952547 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.952640 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.952852 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.953008 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.953157 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.953271 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.953461 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.953575 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.953766 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.953881 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.954091 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.954184 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.954397 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.954504 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.954699 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.954797 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.955004 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.955091 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.955307 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.955402 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.955618 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.955709 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.955930 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.956017 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.956231 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.956335 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.956534 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.956624 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.956838 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.956941 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.957141 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.957240 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.957462 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.957554 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.957764 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.957883 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.958092 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.958189 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.958409 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.958503 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.958711 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.958804 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.959016 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.959120 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.959331 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.959425 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.959635 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.959721 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.959940 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.960041 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.960255 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.960348 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.960553 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.960639 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.961346 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.961450 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.961681 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.961774 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.962015 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.962103 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.962322 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.962416 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.962626 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.962719 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.962927 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.963021 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.963230 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.963317 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.963534 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.963620 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.963835 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.963921 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.964137 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.964225 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.964438 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.964551 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.964747 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.964841 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.965059 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.965160 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.965362 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.965452 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.965667 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.965759 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.966020 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.966118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.966328 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.966420 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.966656 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.966766 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.966988 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.967082 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.967306 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.967405 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.967620 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.967721 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.967934 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.968033 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.968259 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:15:53.968361 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.968578 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.968679 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.968891 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.968990 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.969206 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.969306 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.969530 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.969623 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.969865 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.969960 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.970180 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.970284 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.970493 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.970585 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.970810 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.970910 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.971128 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.971220 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.971455 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.971547 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.971771 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.971863 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.972086 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.972201 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.972401 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.972492 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.972713 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.972805 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.973029 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.973129 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.973356 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.973449 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.973675 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.973775 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.974022 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.974125 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.974349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.974440 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.974667 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.974765 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.974989 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.975086 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.975316 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.975405 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.975639 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.975735 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.975952 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.976050 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.976264 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.976358 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.976652 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.977474 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.977566 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.977659 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.977834 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.977926 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.978129 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.978242 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.978450 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.978563 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.978761 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.978855 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.979076 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.979164 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.979389 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.979477 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.979700 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.979797 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.980013 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.980100 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.980341 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.980428 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.980653 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.980738 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.980969 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.981062 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.981282 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.981370 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.981596 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.981681 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.981932 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.982022 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.982245 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.982348 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.982556 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.982649 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.982860 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.982955 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.983163 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.983261 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.983494 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.983596 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.983807 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.983907 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.984110 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.984197 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.984425 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.984518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.984739 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.984835 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.985044 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.985138 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.985351 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.985453 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.985668 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.985767 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.986007 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.986097 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.986318 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.986404 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.986628 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.986729 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.986934 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.987066 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.987243 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.987331 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.987556 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.987644 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.987868 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.987954 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.988183 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.988274 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.988498 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.988604 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.988808 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.988915 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.989125 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.989252 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.989429 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.989517 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.989734 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.989852 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.990076 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.990174 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.990388 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.990479 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.990699 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.990786 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.991007 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.991102 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.991318 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.991406 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.991630 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.991716 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.991941 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.992034 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.992281 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.992373 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.992597 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.992682 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.992915 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.993016 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.993219 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.993310 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.993543 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.993638 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.993883 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.993988 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.994196 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.994282 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.994499 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.994593 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.994811 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.994900 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.995116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.995203 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.995421 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.995508 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.995722 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.995810 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.996030 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.996120 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.996331 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.996417 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.996635 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.996723 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.996938 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.997032 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.997241 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.997334 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.997542 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.997669 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.997888 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.997990 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.998199 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.998292 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.998500 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.998601 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.998806 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.998911 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.999105 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.999209 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.999410 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.999495 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.999734 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:53.999827 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.000049 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.000148 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.000360 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.000446 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.000669 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.000758 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.000984 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.001085 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.001300 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.001389 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.001616 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.001703 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.001954 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.002044 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.002268 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.002355 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.002578 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.002664 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.002889 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.002978 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.003210 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.003297 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.003521 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.003612 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.003840 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.003936 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.004152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.004240 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.004472 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.004558 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.004777 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.004865 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.005096 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.005182 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.005399 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.005494 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.005714 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.005858 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.006058 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.006143 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.006392 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.006493 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.006708 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.006794 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.007029 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.007115 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.007337 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.007440 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.007649 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.007778 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.007989 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.008077 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.008301 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.008395 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.008611 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.008918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.009007 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.009236 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.009335 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.009546 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.009642 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.009885 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.009976 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.010194 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.010283 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.010510 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.010596 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.010816 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.010901 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.011131 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.011218 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.011431 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.011518 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.011743 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.011830 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.012060 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.012146 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.012387 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.012481 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.012696 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.012783 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.013006 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.013093 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.013312 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.013397 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.013617 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.013710 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.013950 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.014037 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.014261 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.014346 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.014564 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.014663 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.014866 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.014953 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.015174 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.015260 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.015486 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.015588 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.015794 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.015892 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.016102 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.016189 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.016402 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.016498 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.016713 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.016807 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.017017 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.017110 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.017316 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.017404 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.017615 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.017702 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.017952 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.018043 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.018260 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.018356 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.018569 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.018654 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.018878 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.019001 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.019187 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.019275 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.019486 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.019571 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.019785 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.019871 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.020103 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.020191 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.020411 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.020498 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.020712 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.020807 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.021011 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.021099 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.021310 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.021396 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.021642 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.021736 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.021975 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.022124 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.022276 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.022372 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.022591 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.022686 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.022899 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.022983 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.023207 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.023294 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.024041 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.024143 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.024351 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.024438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.024659 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.024746 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.024979 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.025067 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.025292 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.025386 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.025599 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.025686 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.025930 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.026022 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.026241 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.026339 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.026548 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.026635 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.026855 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.026950 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.027174 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.027261 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.027480 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.027574 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.027787 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.027881 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.028095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.028181 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.028401 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.028487 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.028708 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.028795 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.029021 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.029155 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.029334 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.029587 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.029675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.029946 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.030045 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.030267 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.030354 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.030582 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.030668 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.030901 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.030987 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.031219 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.031470 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.031566 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.031810 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.031904 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.032133 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.032220 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.032459 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.032557 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.032780 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.032866 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.033108 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.033203 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.033387 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.033478 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.033698 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.033809 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.034028 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.034115 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.034333 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.034430 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.034635 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.034765 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.034943 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.035030 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.035245 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.035394 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.035547 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.035643 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.035847 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.035934 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.036148 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.036235 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.036460 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.036547 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.036760 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.036849 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.037070 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.037158 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.037372 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.037467 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.037678 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.037764 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.038013 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.038100 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.038324 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.038412 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.038625 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.038711 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.038927 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.039041 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.039293 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.039388 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.039611 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.039697 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.039933 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.040028 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.040248 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.040341 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.040562 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.040650 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.040876 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.040980 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.041181 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.041267 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.041508 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.041604 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.041835 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.041938 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.042143 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.042230 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.042446 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.042556 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.042758 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.042852 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.043068 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.043162 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.043370 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.043484 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.043680 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.043799 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.043990 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.044112 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.044298 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.044424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.044607 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.044743 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.044908 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.045060 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.045217 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.045370 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.045518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.045690 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.045852 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.046038 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.046159 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.046360 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.046449 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.046678 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.046773 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.046988 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.047076 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.047308 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.047396 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.047619 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.047706 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.047926 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.048012 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.048226 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.048315 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.048540 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.048626 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.048841 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.048928 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.049144 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.049232 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.049447 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.049534 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.049755 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.049877 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.050088 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.050174 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.050389 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.050477 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.050708 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.050801 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.051016 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.051102 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.051318 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.051405 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.051620 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.051714 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.051926 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.052013 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.052228 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.052314 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.052528 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.052623 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.052835 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.052922 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.053155 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.053248 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.053462 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.053548 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.053761 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.053877 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.054093 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.054180 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.054397 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.054485 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.055212 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.055308 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.055514 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.055666 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.055824 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.055911 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.056124 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.056210 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.056423 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.056510 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.056724 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.056850 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.057025 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.057115 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.057324 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.057492 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.057638 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.057724 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.057972 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.058072 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.058275 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.058372 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.058578 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.058666 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.058883 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.058968 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.059192 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.059287 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.059503 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.059596 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.059833 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.059920 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.060143 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.060241 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.060450 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.060543 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.060764 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.060851 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.061070 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.061157 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.061378 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.061464 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.061690 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.061776 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.062018 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.062107 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.062332 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.062426 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.062640 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.062734 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.062952 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.063039 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.063255 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.063348 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.063557 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.063643 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.063874 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.063961 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.064183 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.064275 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.064492 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.064579 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.064810 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.064910 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.065125 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.065211 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.065438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.065566 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.065738 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.065853 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.066071 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.066166 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.066380 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.066480 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.066687 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.066774 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.066994 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.067081 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.067300 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.067394 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.067609 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.067695 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.067917 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.068012 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.068479 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.068577 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.068793 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.068879 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.069100 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.069185 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.069402 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.069533 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.069710 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.069830 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.070045 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.070140 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.070394 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.070495 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.070719 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.070812 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.071026 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.071112 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.071329 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.071418 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.071635 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.071730 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.071938 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.072025 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.072244 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.072331 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.072544 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.072630 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.072872 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.072966 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.073191 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.073277 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.073501 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.073588 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.073837 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.073940 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.074152 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.074246 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.074460 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.074547 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.074767 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.074861 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.075074 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.075200 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.075376 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.075520 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.075802 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.075901 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.076113 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.076200 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.076420 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.076513 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.076729 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.076825 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.077030 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.077116 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.077331 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.077417 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.077639 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.077728 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.077986 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.078106 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.078290 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.078425 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.078592 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.078742 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.078899 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.079058 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.079220 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.079367 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.079521 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.079678 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.079840 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.079993 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.080252 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.080347 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.080563 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.080650 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.080866 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.080954 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.081206 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.081306 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.081535 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.081622 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.081874 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.081966 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.082202 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.082300 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.082524 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.082618 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.082845 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.082932 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.083147 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.083247 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.083459 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.083632 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.083769 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.083952 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.084090 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.084271 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.084412 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.084601 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.084719 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.084930 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.085018 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.085263 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.085358 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.085575 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.085670 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.085957 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.086061 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.086282 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.086378 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.086613 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.086708 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.086944 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.087039 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.087263 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.087359 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.087585 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.087680 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.087896 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.087983 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.088227 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.088323 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.088529 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.088667 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.088838 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.088925 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.089146 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.089235 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.089447 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.089606 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.089749 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.089961 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.090096 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.090279 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.090398 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.090609 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.090703 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.090942 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.091038 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.091253 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.091340 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.091562 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.091648 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.091868 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.091963 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.092181 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.092266 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.092480 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.092565 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.092802 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.092897 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.093110 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.093203 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.093429 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.093516 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.093744 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.093860 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.094083 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.094171 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.094394 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.094484 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.094702 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.094798 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.095026 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.095113 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.095330 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.095417 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.095633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.095729 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.095959 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.096045 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.096261 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.096360 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.096581 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.096669 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.096894 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.096981 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.097223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.097352 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.097533 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.097621 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.097866 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.097958 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.098181 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.098286 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.098492 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.098580 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.098811 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.098905 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.099135 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.099232 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.099440 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.099527 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.099742 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.099875 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.100052 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.100141 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.100355 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.100444 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.100657 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.100752 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.100958 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.101046 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.101265 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.101352 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.102111 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.102209 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.102415 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.102526 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.102716 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.102839 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.103037 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.103148 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.103340 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.103463 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.103659 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.103755 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.103968 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.104064 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.104270 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.104359 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.104572 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.104659 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.104872 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.105037 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.105211 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.105299 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.105511 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.105598 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.105864 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.106007 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.106179 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.106267 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.106498 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.106591 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.106812 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.106912 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.107118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.107204 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.107425 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.107518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.107733 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.107822 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.108043 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.108130 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.108368 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.108462 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.108685 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.108780 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.109001 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.109089 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.109322 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.109409 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.109639 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.109727 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.109977 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.110066 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.110294 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.110383 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.110608 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.110704 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.110928 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.111026 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.111252 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.111442 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.111576 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.111771 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.111901 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.112086 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.112224 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.112384 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.112565 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.112698 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.112887 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.113012 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.113213 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.113310 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.113539 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.113626 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.113891 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.113983 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.114240 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.114422 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.114550 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.114757 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.114877 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.115081 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.115199 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.115403 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.115509 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.115725 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.115851 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.116046 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.116142 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.116367 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.116461 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.116686 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.116774 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.117002 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.117115 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.117886 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.117984 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.118211 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.118299 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.118546 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.118635 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.118863 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.118995 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.119178 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.119266 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.119500 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.119588 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.119811 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.119906 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.120122 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.120221 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.120433 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.120521 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.120744 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.120839 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.121054 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.121151 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.121362 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.121449 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.121673 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.121761 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.122011 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.122102 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.122333 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.122420 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.122665 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.122752 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.122983 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.123070 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.123292 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.123377 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.123602 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.123699 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.123916 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.124005 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.124236 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.124432 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.124554 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.124746 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.124890 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.125078 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.125213 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.125402 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.125545 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.125723 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.125895 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.126068 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.126227 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.126384 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.126550 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.126709 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.126871 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.127013 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.127194 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.127315 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.127624 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.127719 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.127931 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.128018 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.128231 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.128352 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.128550 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.128686 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.128860 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.129019 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.129160 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.129346 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.129485 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.129671 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.129806 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.130028 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.130341 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.130430 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.130652 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.130748 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.130970 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.131066 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.131285 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.131373 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.131593 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.131682 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.131912 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.132007 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.132219 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.132316 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.132531 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.132618 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.132860 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.132950 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.133167 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.133269 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.133481 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.133709 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.133818 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.134087 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.134174 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.134392 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.134480 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.134704 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.134821 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.135013 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.135101 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.135316 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.135412 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.135625 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.135713 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.135929 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.136029 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.136250 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.136337 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.136554 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.136640 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.136859 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.136959 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.137162 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.137249 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.137471 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.137557 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.137771 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.137928 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.138097 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.138184 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.138401 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.138487 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.138702 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.138797 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.139011 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.139094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.139318 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.139404 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.139623 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.139711 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.139923 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.140010 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.140232 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.140327 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.140534 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.140623 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.140842 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.140929 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.141149 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.141235 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.141458 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.141553 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.141771 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.141888 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.142098 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.142185 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.142413 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.142503 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.142723 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.142810 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.143038 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.143134 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.143347 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.143433 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.143658 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.143745 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.143964 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.144064 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.144282 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.144370 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.144640 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.144814 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.144971 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.145144 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.145283 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.145462 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.145594 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.145819 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.145940 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.146156 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.146246 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.146459 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.146576 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.146775 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.146897 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.147079 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.147215 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.147401 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.147569 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.147713 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.147893 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.148024 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.148331 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.148458 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.148664 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.148802 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.148974 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.149131 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.149288 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.149475 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.149596 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.149835 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.149927 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.150152 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.150239 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.150467 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.150558 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.150783 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.150872 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.151113 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.151199 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.151423 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.151510 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.151739 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.151827 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.152057 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.152146 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.152372 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.152458 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.152688 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.152776 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.153003 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.153088 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.153306 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.153401 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.153612 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.153699 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.153943 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.154035 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.154254 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.154354 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.154568 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.154655 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.154886 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.154973 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.155194 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.155293 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.155497 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.155584 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.155854 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.155940 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.156191 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.156279 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.156515 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.156601 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.156834 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.156965 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.157144 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.157241 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.157457 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.157552 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.157774 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.157896 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.158113 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.158202 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.158433 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.158520 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.158743 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.158839 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.159069 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.159156 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.159379 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.159477 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.159721 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.159817 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.160043 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.160132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.160348 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.160473 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.160650 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.160752 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.160953 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.161048 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.161262 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.161371 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.161577 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.161702 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.161909 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.162047 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.162213 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.162381 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.162516 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.162700 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.162825 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.163036 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.163131 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.163383 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.163479 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.163708 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.163794 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.164531 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.164628 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.164842 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.164931 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.165143 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.165237 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.165445 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.165531 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.165750 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.165857 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.166078 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.166183 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.166383 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.166470 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.166686 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.166775 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.166994 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.167080 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.167292 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.167384 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.167596 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.167683 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.167895 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.167989 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.168198 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.168294 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.168500 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.168587 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.168816 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.168903 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.169129 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.169228 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.169443 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.169542 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.169754 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.169895 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.170094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.170194 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.170406 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.170494 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.170711 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.170806 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.171027 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.171126 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.171339 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.171467 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.171650 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.171739 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.171959 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.172048 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.172271 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.172359 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.172582 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.172676 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.172892 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.172982 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.173201 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.173289 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.173508 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.173595 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.173835 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.173928 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.174150 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.174238 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.174474 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.174563 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.174799 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.174887 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.175102 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.175189 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.175424 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.175521 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.175739 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.175827 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.176058 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.176144 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.176372 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.176466 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.176684 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.176771 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.177006 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.177094 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.177315 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.177410 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.177624 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.177712 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.177962 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.178060 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.178270 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.178358 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.178598 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.178687 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.178914 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.179009 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.179227 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.179322 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.179552 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.179701 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.180419 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.180508 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.180742 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.180837 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.181064 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.181150 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.181386 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.181481 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.181724 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.181842 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.182064 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.182151 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.182386 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.182481 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.182712 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.182800 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.183022 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.183115 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.183336 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.183440 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.183641 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.183728 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.183883 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:15:54.183971 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.184285 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.184621 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.184941 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.185274 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.185607 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.185991 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.186316 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.186667 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.187005 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.187325 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.187647 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.187960 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:15:54.188208 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:15:54.207508 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_db.sqlalchemy.engines [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:15:54.211115 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG oslo_db.sqlalchemy.engines [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:15:54.276014 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.context [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6cb824f0-0b0e-46be-89c3-2da60fc44ef7(cell1) {{(pid=103238) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:15:54.279631 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.context [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6cb824f0-0b0e-46be-89c3-2da60fc44ef7(cell1) {{(pid=103237) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:15:54.280350 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:15:54.281962 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:15:54.282750 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:15:54.283952 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG oslo_concurrency.lockutils [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103237) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:15:54.284703 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:15:54.285517 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG oslo_concurrency.lockutils [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103237) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:15:54.286407 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG oslo_concurrency.lockutils [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103237) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:15:54.288354 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG oslo_concurrency.lockutils [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103237) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:15:54.296513 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_db.sqlalchemy.engines [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:15:54.297946 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_db.sqlalchemy.engines [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:15:54.301873 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG oslo_db.sqlalchemy.engines [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:15:54.306477 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG oslo_db.sqlalchemy.engines [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:15:54.480045 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_db.sqlalchemy.engines [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:15:54.487248 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG oslo_db.sqlalchemy.engines [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:15:54.896762 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: WARNING keystonemiddleware.auth_token [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:15:54.904121 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: WARNING keystonemiddleware.auth_token [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:15:54.923141 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: WARNING keystonemiddleware.auth_token [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:15:54.931041 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: WARNING keystonemiddleware.auth_token [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:15:55.245773 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: WARNING keystonemiddleware.auth_token [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:15:55.251940 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: WARNING keystonemiddleware.auth_token [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:15:55.258080 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c45805f9c0 pid: 103238 (default app) May 13 13:15:55.260148 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:15:55.261320 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001733 May 13 13:15:55.261737 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Fri May 13 13:15:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:15:55.272232 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: WARNING keystonemiddleware.auth_token [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:15:55.278872 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: WARNING keystonemiddleware.auth_token [None req-95f2f9c7-3eb6-42bd-96a4-0b7a287db241 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:15:55.285022 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c45805f9c0 pid: 103237 (default app) May 13 13:17:16.051124 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:16.052152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 13 13:17:16.055300 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:17:16 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:16.484721 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-86f6e895-0e5c-4274-9b85-469fbfebcf28 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:16.516494 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-86f6e895-0e5c-4274-9b85-469fbfebcf28 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.457207 May 13 13:17:16.517203 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1291 bytes} [Fri May 13 13:17:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:17:18.834825 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:18.836410 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-c221deda-20ae-4621-964c-2db38ff8045d None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 May 13 13:17:18.836995 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:17:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:18.901175 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-f4c84975-54dc-421e-a2cc-193c5218d8a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "swap": 0, "id": "c1"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:18.920941 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:17:18.920941 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: warnings.warn(msg) May 13 13:17:19.010594 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-f4c84975-54dc-421e-a2cc-193c5218d8a0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.167773 May 13 13:17:19.019342 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1282 bytes} [Fri May 13 13:17:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:17:19.233596 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-ace59caa-f4eb-46cc-bffe-7ea231d2ad5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:19.236073 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:17:19.236073 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: warnings.warn(msg) May 13 13:17:19.355290 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-ace59caa-f4eb-46cc-bffe-7ea231d2ad5e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.332032 May 13 13:17:19.355878 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1335 bytes} [Fri May 13 13:17:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:17:21.633662 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-f4c84975-54dc-421e-a2cc-193c5218d8a0 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:21.634734 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-f4c84975-54dc-421e-a2cc-193c5218d8a0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 May 13 13:17:21.635183 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:17:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:21.739596 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-b468ef89-7c3f-4b61-b155-052f4fe8f340 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "ram": 512, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:21.757809 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:17:21.757809 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: warnings.warn(msg) May 13 13:17:21.892110 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-b468ef89-7c3f-4b61-b155-052f4fe8f340 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.251227 May 13 13:17:21.892690 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1282 bytes} [Fri May 13 13:17:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:17:21.905245 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-fd4887d5-db74-4baa-b84c-3a5023526b93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:21.906694 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:17:21.906694 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: warnings.warn(msg) May 13 13:17:22.008634 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-fd4887d5-db74-4baa-b84c-3a5023526b93 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107137 May 13 13:17:22.009587 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1335 bytes} [Fri May 13 13:17:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:17:24.346008 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-b468ef89-7c3f-4b61-b155-052f4fe8f340 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:24.346516 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-b468ef89-7c3f-4b61-b155-052f4fe8f340 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 13 13:17:24.346516 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:17:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:24.408661 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-aa5b4e00-8e00-4f7f-a29e-146855469928 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:24.503706 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-aa5b4e00-8e00-4f7f-a29e-146855469928 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150571 May 13 13:17:24.509857 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1282 bytes} [Fri May 13 13:17:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:17:24.516943 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-aa54e5ab-dacb-4d7a-b7d7-24da8221d917 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:24.597651 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-aa54e5ab-dacb-4d7a-b7d7-24da8221d917 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084534 May 13 13:17:24.598225 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1335 bytes} [Fri May 13 13:17:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:17:26.944117 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-aa5b4e00-8e00-4f7f-a29e-146855469928 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:26.945165 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-aa5b4e00-8e00-4f7f-a29e-146855469928 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002299 May 13 13:17:26.945567 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:17:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:27.004493 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-1d083b0b-4cc8-46af-98d6-7f1f8cdd4d0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "disk": 10}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:27.084072 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-1d083b0b-4cc8-46af-98d6-7f1f8cdd4d0f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132432 May 13 13:17:27.084635 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1282 bytes} [Fri May 13 13:17:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:17:27.096638 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-b77f89c1-8320-4c42-b953-6cae9cd3d251 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:27.199654 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-b77f89c1-8320-4c42-b953-6cae9cd3d251 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106972 May 13 13:17:27.200251 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1335 bytes} [Fri May 13 13:17:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:17:29.464423 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-1d083b0b-4cc8-46af-98d6-7f1f8cdd4d0f admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:29.465438 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-1d083b0b-4cc8-46af-98d6-7f1f8cdd4d0f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 13 13:17:29.466001 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:17:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:29.531336 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-17e4192c-fe0a-40b3-a28f-89e77a0bd45d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "ram": 4096, "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:29.609446 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-17e4192c-fe0a-40b3-a28f-89e77a0bd45d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137994 May 13 13:17:29.610501 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1282 bytes} [Fri May 13 13:17:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:17:29.623591 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-7fce6e34-a8f8-4114-bfe1-13ccfecd07aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:29.722071 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-7fce6e34-a8f8-4114-bfe1-13ccfecd07aa admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102860 May 13 13:17:29.722966 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1335 bytes} [Fri May 13 13:17:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:17:32.010130 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-17e4192c-fe0a-40b3-a28f-89e77a0bd45d admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:32.011149 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-17e4192c-fe0a-40b3-a28f-89e77a0bd45d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 13 13:17:32.011738 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:17:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:32.071692 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-3a8a6ba7-6739-49c6-97b7-cc6051013190 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:32.096624 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-3a8a6ba7-6739-49c6-97b7-cc6051013190 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078716 May 13 13:17:32.097663 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1291 bytes} [Fri May 13 13:17:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:17:34.410000 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-17e4192c-fe0a-40b3-a28f-89e77a0bd45d admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:34.411019 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-17e4192c-fe0a-40b3-a28f-89e77a0bd45d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 13 13:17:34.411469 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:17:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:34.471281 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-cebcdf98-cb1f-49be-b7bd-3991748867e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "disk": 1, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:34.557632 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-cebcdf98-cb1f-49be-b7bd-3991748867e1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.140298 May 13 13:17:34.558456 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1282 bytes} [Fri May 13 13:17:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:17:34.575401 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-07e7c6c8-d90d-43aa-b217-f6dc2bc193bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:34.643889 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-07e7c6c8-d90d-43aa-b217-f6dc2bc193bb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076904 May 13 13:17:34.644398 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1332 bytes} [Fri May 13 13:17:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:17:36.930828 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-cebcdf98-cb1f-49be-b7bd-3991748867e1 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:36.931851 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-cebcdf98-cb1f-49be-b7bd-3991748867e1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 13 13:17:36.932256 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:17:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:36.997641 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-9cfd0a56-3b8e-4d75-b052-1a9dd0192a4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "name": "m1.small", "disk": 20}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:37.086916 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-9cfd0a56-3b8e-4d75-b052-1a9dd0192a4e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.148575 May 13 13:17:37.087490 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1282 bytes} [Fri May 13 13:17:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:17:37.099688 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-cabc06d0-de97-4a3a-97e8-b3fea8a08b3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:37.209679 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-cabc06d0-de97-4a3a-97e8-b3fea8a08b3b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113703 May 13 13:17:37.210250 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1332 bytes} [Fri May 13 13:17:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:17:39.523192 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-9cfd0a56-3b8e-4d75-b052-1a9dd0192a4e admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:39.524201 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-9cfd0a56-3b8e-4d75-b052-1a9dd0192a4e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 13 13:17:39.524948 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:17:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:39.585273 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-1b76d415-76f3-48c3-ad04-d63cc5ec8dad admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:39.662366 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-1b76d415-76f3-48c3-ad04-d63cc5ec8dad admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.131376 May 13 13:17:39.662840 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1282 bytes} [Fri May 13 13:17:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:17:39.674673 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-2668a842-bce9-4f0a-a441-eebf4346847d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:39.728390 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-2668a842-bce9-4f0a-a441-eebf4346847d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057401 May 13 13:17:39.729159 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1332 bytes} [Fri May 13 13:17:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:17:41.998759 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-1b76d415-76f3-48c3-ad04-d63cc5ec8dad admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:41.999828 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-1b76d415-76f3-48c3-ad04-d63cc5ec8dad admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 May 13 13:17:42.000221 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:17:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:42.058762 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-43802226-0b77-4998-98f7-887fd6c390ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:42.164167 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-43802226-0b77-4998-98f7-887fd6c390ca admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.151343 May 13 13:17:42.164167 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1282 bytes} [Fri May 13 13:17:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:17:42.170583 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-05f3ab70-7d6c-4d61-9546-d993e861772c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:42.254502 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-05f3ab70-7d6c-4d61-9546-d993e861772c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087954 May 13 13:17:42.255620 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1332 bytes} [Fri May 13 13:17:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:17:44.628980 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-43802226-0b77-4998-98f7-887fd6c390ca admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:17:44.630985 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-43802226-0b77-4998-98f7-887fd6c390ca admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002423 May 13 13:17:44.631383 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:17:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:17:44.710357 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-58ceb338-525f-4795-9665-115161a31240 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "disk": 160}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:44.854631 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-58ceb338-525f-4795-9665-115161a31240 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.209909 May 13 13:17:44.855195 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1282 bytes} [Fri May 13 13:17:44 2022] POST /compute/v2.1/flavors => generated 408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:17:44.867532 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-95269e1a-da3a-40c2-93c6-e948d1aa33e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:17:45.060402 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-95269e1a-da3a-40c2-93c6-e948d1aa33e5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.197082 May 13 13:17:45.061061 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1332 bytes} [Fri May 13 13:17:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:18:09.706775 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-58ceb338-525f-4795-9665-115161a31240 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:09.708263 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-58ceb338-525f-4795-9665-115161a31240 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001918 May 13 13:18:09.708654 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:18:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:18:09.767248 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-14c3de77-f453-455f-9972-603cfdb637ca admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:09.786453 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-14c3de77-f453-455f-9972-603cfdb637ca admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071236 May 13 13:18:09.786982 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1291 bytes} [Fri May 13 13:18:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:18:10.797125 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-58ceb338-525f-4795-9665-115161a31240 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:10.798145 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-58ceb338-525f-4795-9665-115161a31240 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 May 13 13:18:10.798542 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Fri May 13 13:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:18:11.005610 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-5e4e12d5-1df2-49f1-be2a-d425573a803f admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:11.011570 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.wsgi [None req-5e4e12d5-1df2-49f1-be2a-d425573a803f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-5e4e12d5-1df2-49f1-be2a-d425573a803f admin admin] Request method failure captured: May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Accept: application/json May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Accept-Encoding: gzip, deflate May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Connection: keep-alive May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Content-Length: 0 May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Host: 10.222.0.25 May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Openstack-Api-Version: compute 2.90 May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Openstack-System-Scope: None May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: User-Agent: python-novaclient May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Auth-Token: gAAAAABiflqSOFaD0_m8Olqi6g6HqH0TDAImLV28UE7cYmIsYywxtzppXdrtVoXlkAEhMLhlT8jji0ISmMa2WmzJv__71cA_kcbi1tP23c6b1wnMrgRVewEqqk0IGKt-OYDGKviM9cWpFp5undXvDv-GD4jEKbuKSbAtYcnJRmFOSVv_oWsEieU May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Domain-Id: None May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Domain-Name: None May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Identity-Status: Confirmed May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Is-Admin-Project: True May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Project-Domain-Id: default May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Project-Domain-Name: Default May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Project-Id: 989de7565a074e299634e689ed15d9f9 May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Project-Name: admin May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Role: admin,reader,member May 13 13:18:11.014720 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Roles: admin,reader,member May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/989de7565a074e299634e689ed15d9f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_989de7565a074e299634e689ed15d9f9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/989de7565a074e299634e689ed15d9f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/989de7565a074e299634e689ed15d9f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Tenant: admin May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Tenant-Id: 989de7565a074e299634e689ed15d9f9 May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Tenant-Name: admin May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User: admin May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User-Domain-Id: default May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User-Domain-Name: Default May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User-Id: df2ff43339cf407eb4cebe6484112e01 May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User-Name: admin May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: method: > May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: exception: Flavor 42 could not be found. May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: action_args: {'id': '42'} May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:18:11.016442 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:18:11.017424 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:11.018675 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-5e4e12d5-1df2-49f1-be2a-d425573a803f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103237) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:18:11.020388 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-5e4e12d5-1df2-49f1-be2a-d425573a803f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064134 May 13 13:18:11.020388 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Fri May 13 13:18:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:18:11.026508 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-2590f536-275c-40e6-afe3-4a75fec879bc admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:11.049286 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-2590f536-275c-40e6-afe3-4a75fec879bc admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026361 May 13 13:18:11.049844 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Fri May 13 13:18:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:18:11.061331 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-d251d49b-52bb-46e9-80fd-c07cbb01da72 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:11.083603 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-d251d49b-52bb-46e9-80fd-c07cbb01da72 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025826 May 13 13:18:11.084147 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Fri May 13 13:18:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:18:11.093378 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-cd165b9c-e0c2-4d3e-963f-089ba284b1fb admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:11.099843 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.wsgi [None req-cd165b9c-e0c2-4d3e-963f-089ba284b1fb admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-cd165b9c-e0c2-4d3e-963f-089ba284b1fb admin admin] Request method failure captured: May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Accept: application/json May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Accept-Encoding: gzip, deflate May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Connection: keep-alive May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Content-Length: 0 May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Host: 10.222.0.25 May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Openstack-Api-Version: compute 2.90 May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Openstack-System-Scope: None May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: User-Agent: python-novaclient May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Auth-Token: gAAAAABiflqSOFaD0_m8Olqi6g6HqH0TDAImLV28UE7cYmIsYywxtzppXdrtVoXlkAEhMLhlT8jji0ISmMa2WmzJv__71cA_kcbi1tP23c6b1wnMrgRVewEqqk0IGKt-OYDGKviM9cWpFp5undXvDv-GD4jEKbuKSbAtYcnJRmFOSVv_oWsEieU May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Domain-Id: None May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Domain-Name: None May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Identity-Status: Confirmed May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Is-Admin-Project: True May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Project-Domain-Id: default May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Project-Domain-Name: Default May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Project-Id: 989de7565a074e299634e689ed15d9f9 May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Project-Name: admin May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Role: admin,reader,member May 13 13:18:11.103116 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Roles: admin,reader,member May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/989de7565a074e299634e689ed15d9f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_989de7565a074e299634e689ed15d9f9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/989de7565a074e299634e689ed15d9f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/989de7565a074e299634e689ed15d9f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Tenant: admin May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Tenant-Id: 989de7565a074e299634e689ed15d9f9 May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Tenant-Name: admin May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User: admin May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User-Domain-Id: default May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User-Domain-Name: Default May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User-Id: df2ff43339cf407eb4cebe6484112e01 May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User-Name: admin May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: method: > May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: exception: Flavor 42 could not be found. May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: action_args: {'id': '42'} May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:18:11.104637 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:18:11.105633 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:11.106918 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-cd165b9c-e0c2-4d3e-963f-089ba284b1fb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103238) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:18:11.108227 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-cd165b9c-e0c2-4d3e-963f-089ba284b1fb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014715 May 13 13:18:11.108227 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Fri May 13 13:18:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:18:11.995201 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-d251d49b-52bb-46e9-80fd-c07cbb01da72 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:11.996243 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-d251d49b-52bb-46e9-80fd-c07cbb01da72 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 13 13:18:11.996640 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Fri May 13 13:18:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:18:12.188916 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-cf80bb2f-0eb1-4ad6-8955-1cb55078f0d2 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:12.194985 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.wsgi [None req-cf80bb2f-0eb1-4ad6-8955-1cb55078f0d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-cf80bb2f-0eb1-4ad6-8955-1cb55078f0d2 admin admin] Request method failure captured: May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Accept: application/json May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Accept-Encoding: gzip, deflate May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Connection: keep-alive May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Content-Length: 0 May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Host: 10.222.0.25 May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Openstack-Api-Version: compute 2.90 May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Openstack-System-Scope: None May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: User-Agent: python-novaclient May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Auth-Token: gAAAAABiflqTDErLd0hrE5Is6HW5wAlMSNtPU4_M7bBD7z23G5kJcQ-nQ9UVfz-WCVfftnaZE6EU4yYee2L-e5lYi57FQQlfJW6kmqxSBwZrF-Pbq1iIqZuVFwxn9IltE-aMGwUm4STfEb-DMYdQ8RM6nrLs_ySQwQYIAiPieqXc39KYvY9Gcec May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Domain-Id: None May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Domain-Name: None May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Identity-Status: Confirmed May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Is-Admin-Project: True May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Project-Domain-Id: default May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Project-Domain-Name: Default May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Project-Id: 989de7565a074e299634e689ed15d9f9 May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Project-Name: admin May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Role: admin,reader,member May 13 13:18:12.196518 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Roles: admin,reader,member May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/989de7565a074e299634e689ed15d9f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_989de7565a074e299634e689ed15d9f9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/989de7565a074e299634e689ed15d9f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/989de7565a074e299634e689ed15d9f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Tenant: admin May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Tenant-Id: 989de7565a074e299634e689ed15d9f9 May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Tenant-Name: admin May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User: admin May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User-Domain-Id: default May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User-Domain-Name: Default May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User-Id: df2ff43339cf407eb4cebe6484112e01 May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User-Name: admin May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: method: > May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: exception: Flavor 84 could not be found. May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: action_args: {'id': '84'} May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:18:12.198118 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:18:12.199095 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:12.200152 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-cf80bb2f-0eb1-4ad6-8955-1cb55078f0d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103238) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:18:12.201260 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-cf80bb2f-0eb1-4ad6-8955-1cb55078f0d2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063072 May 13 13:18:12.201260 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Fri May 13 13:18:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:18:12.208358 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-70de6723-3e81-48dc-b680-69ae544a751d admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:12.222620 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-70de6723-3e81-48dc-b680-69ae544a751d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018451 May 13 13:18:12.223239 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Fri May 13 13:18:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:18:12.232816 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-bd17df6e-8a16-4bd1-8772-962e740cde09 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:12.246276 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-bd17df6e-8a16-4bd1-8772-962e740cde09 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016963 May 13 13:18:12.246788 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Fri May 13 13:18:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:18:12.256326 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-58579f7a-c0cc-444e-9b33-e4cd842586af admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:12.261559 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.wsgi [None req-58579f7a-c0cc-444e-9b33-e4cd842586af admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-58579f7a-c0cc-444e-9b33-e4cd842586af admin admin] Request method failure captured: May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Accept: application/json May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Accept-Encoding: gzip, deflate May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Connection: keep-alive May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Content-Length: 0 May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Host: 10.222.0.25 May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Openstack-Api-Version: compute 2.90 May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Openstack-System-Scope: None May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: User-Agent: python-novaclient May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Auth-Token: gAAAAABiflqTDErLd0hrE5Is6HW5wAlMSNtPU4_M7bBD7z23G5kJcQ-nQ9UVfz-WCVfftnaZE6EU4yYee2L-e5lYi57FQQlfJW6kmqxSBwZrF-Pbq1iIqZuVFwxn9IltE-aMGwUm4STfEb-DMYdQ8RM6nrLs_ySQwQYIAiPieqXc39KYvY9Gcec May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Domain-Id: None May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Domain-Name: None May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Identity-Status: Confirmed May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Is-Admin-Project: True May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Project-Domain-Id: default May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Project-Domain-Name: Default May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Project-Id: 989de7565a074e299634e689ed15d9f9 May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Project-Name: admin May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Role: admin,reader,member May 13 13:18:12.263094 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Roles: admin,reader,member May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/989de7565a074e299634e689ed15d9f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_989de7565a074e299634e689ed15d9f9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/989de7565a074e299634e689ed15d9f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/989de7565a074e299634e689ed15d9f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Tenant: admin May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Tenant-Id: 989de7565a074e299634e689ed15d9f9 May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Tenant-Name: admin May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User: admin May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User-Domain-Id: default May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User-Domain-Name: Default May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User-Id: df2ff43339cf407eb4cebe6484112e01 May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User-Name: admin May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: method: > May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: exception: Flavor 84 could not be found. May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: action_args: {'id': '84'} May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:18:12.272349 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:18:12.273132 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:12.274323 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-58579f7a-c0cc-444e-9b33-e4cd842586af admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103237) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:18:12.275601 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-58579f7a-c0cc-444e-9b33-e4cd842586af admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012221 May 13 13:18:12.275601 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Fri May 13 13:18:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:18:13.188602 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-bd17df6e-8a16-4bd1-8772-962e740cde09 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:13.189603 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-bd17df6e-8a16-4bd1-8772-962e740cde09 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 13 13:18:13.190177 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Fri May 13 13:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:18:13.390471 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-aa9b0bcf-15dd-48ec-9a82-6f368fb5d15a admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:13.396481 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.wsgi [None req-aa9b0bcf-15dd-48ec-9a82-6f368fb5d15a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-aa9b0bcf-15dd-48ec-9a82-6f368fb5d15a admin admin] Request method failure captured: May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Accept: application/json May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Accept-Encoding: gzip, deflate May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Connection: keep-alive May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Content-Length: 0 May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Host: 10.222.0.25 May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Openstack-Api-Version: compute 2.90 May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Openstack-System-Scope: None May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: User-Agent: python-novaclient May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Auth-Token: gAAAAABiflqVNxLL8HVxOS9b7BR_IpMN2g9PuTCGxwwEU3rY26Q-TKIPymG5p2H7ARvvnO8bmFU2OVQcVyuPtzKelm6DMHI29ekmSvyzQa3bbgoWP-x3YNB1HjoKSY6VhzW7s2bzcgEoPqBx48RmqHfMhmJ4SmRK_rjXQiZucIO9ytI3rI34A8M May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Domain-Id: None May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Domain-Name: None May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Identity-Status: Confirmed May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Is-Admin-Project: True May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Project-Domain-Id: default May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Project-Domain-Name: Default May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Project-Id: 989de7565a074e299634e689ed15d9f9 May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Project-Name: admin May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Role: admin,reader,member May 13 13:18:13.398001 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Roles: admin,reader,member May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/989de7565a074e299634e689ed15d9f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_989de7565a074e299634e689ed15d9f9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/989de7565a074e299634e689ed15d9f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/989de7565a074e299634e689ed15d9f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Tenant: admin May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Tenant-Id: 989de7565a074e299634e689ed15d9f9 May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-Tenant-Name: admin May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User: admin May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User-Domain-Id: default May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User-Domain-Name: Default May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User-Id: df2ff43339cf407eb4cebe6484112e01 May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: X-User-Name: admin May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: method: > May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: exception: Flavor 451 could not be found. May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: action_args: {'id': '451'} May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:18:13.399602 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:18:13.400438 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 13 13:18:13.401726 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-aa9b0bcf-15dd-48ec-9a82-6f368fb5d15a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103237) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:18:13.403054 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-aa9b0bcf-15dd-48ec-9a82-6f368fb5d15a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062275 May 13 13:18:13.403054 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Fri May 13 13:18:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:18:13.409873 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-ac9c5ece-d037-4ce1-aee6-d74df47e361f admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:13.424007 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-ac9c5ece-d037-4ce1-aee6-d74df47e361f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018234 May 13 13:18:13.424561 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Fri May 13 13:18:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:18:13.436313 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:13.452060 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020707 May 13 13:18:13.452609 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Fri May 13 13:18:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:18:13.462001 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-6b687a92-a387-491f-852e-c305bcf48134 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:13.468653 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.wsgi [None req-6b687a92-a387-491f-852e-c305bcf48134 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-6b687a92-a387-491f-852e-c305bcf48134 admin admin] Request method failure captured: May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Accept: application/json May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Accept-Encoding: gzip, deflate May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Connection: keep-alive May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Content-Length: 0 May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Host: 10.222.0.25 May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Openstack-Api-Version: compute 2.90 May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Openstack-System-Scope: None May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: User-Agent: python-novaclient May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Auth-Token: gAAAAABiflqVNxLL8HVxOS9b7BR_IpMN2g9PuTCGxwwEU3rY26Q-TKIPymG5p2H7ARvvnO8bmFU2OVQcVyuPtzKelm6DMHI29ekmSvyzQa3bbgoWP-x3YNB1HjoKSY6VhzW7s2bzcgEoPqBx48RmqHfMhmJ4SmRK_rjXQiZucIO9ytI3rI34A8M May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Domain-Id: None May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Domain-Name: None May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Identity-Status: Confirmed May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Is-Admin-Project: True May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Project-Domain-Id: default May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Project-Domain-Name: Default May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Project-Id: 989de7565a074e299634e689ed15d9f9 May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Project-Name: admin May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Role: admin,reader,member May 13 13:18:13.470192 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Roles: admin,reader,member May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/989de7565a074e299634e689ed15d9f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_989de7565a074e299634e689ed15d9f9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/989de7565a074e299634e689ed15d9f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/989de7565a074e299634e689ed15d9f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Tenant: admin May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Tenant-Id: 989de7565a074e299634e689ed15d9f9 May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-Tenant-Name: admin May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User: admin May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User-Domain-Id: default May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User-Domain-Name: Default May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User-Id: df2ff43339cf407eb4cebe6484112e01 May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: X-User-Name: admin May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: method: > May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: exception: Flavor 451 could not be found. May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: action_args: {'id': '451'} May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:18:13.471790 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:18:13.472784 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 13 13:18:13.474223 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-6b687a92-a387-491f-852e-c305bcf48134 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103238) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:18:13.475472 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-6b687a92-a387-491f-852e-c305bcf48134 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013172 May 13 13:18:13.475472 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Fri May 13 13:18:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:18:14.398643 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:14.399661 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 13 13:18:14.400065 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Fri May 13 13:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:18:14.586320 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-bb0d0a1e-b3c7-4af5-aab0-c6f58732e7be admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:18:14.685403 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-bb0d0a1e-b3c7-4af5-aab0-c6f58732e7be admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.149827 May 13 13:18:14.685886 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Fri May 13 13:18:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:18:15.569708 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:15.570770 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001728 May 13 13:18:15.571167 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Fri May 13 13:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:18:15.758198 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-5f6a4105-f999-442e-bc42-61cba2cde3ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:18:15.836743 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-5f6a4105-f999-442e-bc42-61cba2cde3ab admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.129328 May 13 13:18:15.837291 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Fri May 13 13:18:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:18:16.722429 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:16.723431 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 13 13:18:16.723822 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Fri May 13 13:18:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:18:16.909978 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-2043d5b4-3d9d-49a2-89be-eba2c7728d92 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:18:17.010845 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-2043d5b4-3d9d-49a2-89be-eba2c7728d92 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.152778 May 13 13:18:17.011389 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Fri May 13 13:18:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:18:17.906141 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:17.907221 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 13 13:18:17.907622 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Fri May 13 13:18:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:18:18.098981 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-4a2c4b73-97a1-48c4-9fc6-5634fa161f64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:18:18.182623 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-4a2c4b73-97a1-48c4-9fc6-5634fa161f64 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.138702 May 13 13:18:18.183089 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Fri May 13 13:18:18 2022] POST /compute/v2.1/flavors => generated 409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:18:19.083913 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:19.085287 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 13 13:18:19.085690 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Fri May 13 13:18:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:18:19.285560 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-1039ab97-722a-4b12-8180-4a01f9793152 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:18:19.305360 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-1039ab97-722a-4b12-8180-4a01f9793152 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070412 May 13 13:18:19.305847 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Fri May 13 13:18:19 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:19:21.744672 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:19:21.745691 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-45a59169-fe84-4a69-bf18-d8d6752a73fb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 13 13:19:21.746127 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 930 bytes} [Fri May 13 13:19:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:19:21.806013 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-9cd7f286-1a0e-4e6d-9c5e-a54e3e27ac42 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:19:21.826021 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-9cd7f286-1a0e-4e6d-9c5e-a54e3e27ac42 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074067 May 13 13:19:21.826549 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1291 bytes} [Fri May 13 13:19:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:19:21.850791 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-379382c0-5f7b-475d-8ec6-994564d6b8f6 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:19:21.858632 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-379382c0-5f7b-475d-8ec6-994564d6b8f6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012969 May 13 13:19:21.859192 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1282 bytes} [Fri May 13 13:19:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:19:21.871256 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-4a351757-1015-45e4-9d55-6c9e712c7d14 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:19:21.879137 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-4a351757-1015-45e4-9d55-6c9e712c7d14 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011517 May 13 13:19:21.879665 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1285 bytes} [Fri May 13 13:19:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:19:21.890878 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-4d30f5e0-edae-4747-bfd0-1f9683289367 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:19:21.898665 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-4d30f5e0-edae-4747-bfd0-1f9683289367 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011361 May 13 13:19:21.899215 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1285 bytes} [Fri May 13 13:19:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:19:21.910884 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-75121e0b-79ed-4c79-b55e-9d6a9497d70b admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:19:21.918302 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-75121e0b-79ed-4c79-b55e-9d6a9497d70b admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011513 May 13 13:19:21.918804 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1282 bytes} [Fri May 13 13:19:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:23:05.016032 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-4d30f5e0-edae-4747-bfd0-1f9683289367 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:05.017089 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-4d30f5e0-edae-4747-bfd0-1f9683289367 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 May 13 13:23:05.017523 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Fri May 13 13:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:05.290433 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-3f24ee2b-749c-4810-a4d6-e02e9113d0cb admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:05.291606 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:23:05.291606 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: warnings.warn(msg) May 13 13:23:05.292794 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-3f24ee2b-749c-4810-a4d6-e02e9113d0cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:05.293232 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-3f24ee2b-749c-4810-a4d6-e02e9113d0cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:05.294121 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-3f24ee2b-749c-4810-a4d6-e02e9113d0cb admin admin] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:05.294546 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-3f24ee2b-749c-4810-a4d6-e02e9113d0cb admin admin] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:05.328845 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-3f24ee2b-749c-4810-a4d6-e02e9113d0cb admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150983 May 13 13:23:05.329411 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Fri May 13 13:23:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:23:06.225223 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-4d30f5e0-edae-4747-bfd0-1f9683289367 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:06.226368 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-4d30f5e0-edae-4747-bfd0-1f9683289367 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 13 13:23:06.226808 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Fri May 13 13:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:06.423097 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-f2b1827e-6308-4a54-a748-21dd64e43442 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:06.424765 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:23:06.424765 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: warnings.warn(msg) May 13 13:23:06.425968 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-f2b1827e-6308-4a54-a748-21dd64e43442 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:06.426417 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-f2b1827e-6308-4a54-a748-21dd64e43442 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:06.427199 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-f2b1827e-6308-4a54-a748-21dd64e43442 admin admin] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:06.427623 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-f2b1827e-6308-4a54-a748-21dd64e43442 admin admin] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:06.447323 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-f2b1827e-6308-4a54-a748-21dd64e43442 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076057 May 13 13:23:06.447803 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Fri May 13 13:23:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:23:17.809218 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-4d30f5e0-edae-4747-bfd0-1f9683289367 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:17.810273 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-4d30f5e0-edae-4747-bfd0-1f9683289367 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 May 13 13:23:17.816149 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Fri May 13 13:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:23:18.004419 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-a234f1c5-b298-4cfe-baeb-6eb1f43132bd admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:18.005629 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:23:18.005629 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: warnings.warn(msg) May 13 13:23:18.006960 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-a234f1c5-b298-4cfe-baeb-6eb1f43132bd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:18.007469 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-a234f1c5-b298-4cfe-baeb-6eb1f43132bd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:18.008313 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-a234f1c5-b298-4cfe-baeb-6eb1f43132bd admin admin] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:18.008795 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-a234f1c5-b298-4cfe-baeb-6eb1f43132bd admin admin] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:18.034044 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-a234f1c5-b298-4cfe-baeb-6eb1f43132bd admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080297 May 13 13:23:18.034529 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Fri May 13 13:23:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:23:18.946868 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-4d30f5e0-edae-4747-bfd0-1f9683289367 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:18.947904 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-4d30f5e0-edae-4747-bfd0-1f9683289367 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 13 13:23:18.948294 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Fri May 13 13:23:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:23:19.136962 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-ee601390-73b3-4a23-a99c-487b882a8448 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:23:19.138183 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:23:19.138183 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: warnings.warn(msg) May 13 13:23:19.139395 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-ee601390-73b3-4a23-a99c-487b882a8448 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:19.139839 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-ee601390-73b3-4a23-a99c-487b882a8448 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:19.140639 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-ee601390-73b3-4a23-a99c-487b882a8448 admin admin] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:23:19.141071 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-ee601390-73b3-4a23-a99c-487b882a8448 admin admin] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:23:19.164030 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-ee601390-73b3-4a23-a99c-487b882a8448 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080063 May 13 13:23:19.164512 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Fri May 13 13:23:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:24:18.073107 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: Fri May 13 13:24:18 2022 - graceful shutdown triggered... May 13 13:24:18.073703 dv-cinder-841591-2-iscsi devstack@n-api.service[103237]: Gracefully killing worker 1 (pid: 103237)... May 13 13:24:18.073199 dv-cinder-841591-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 13 13:24:18.074616 dv-cinder-841591-2-iscsi devstack@n-api.service[103238]: Gracefully killing worker 2 (pid: 103238)... May 13 13:24:19.074242 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: worker 1 buried after 1 seconds May 13 13:24:19.074242 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: worker 2 buried after 1 seconds May 13 13:24:19.074242 dv-cinder-841591-2-iscsi devstack@n-api.service[103236]: goodbye to uWSGI. May 13 13:24:19.075846 dv-cinder-841591-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 13 13:24:19.076428 dv-cinder-841591-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 13 13:24:19.079199 dv-cinder-841591-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 13:24:19.094416 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 13:24:19.110631 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 13:24:19 2022] *** May 13 13:24:19.110631 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 13:24:19.110631 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 13:24:19.110631 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: nodename: dv-cinder-841591-2-iscsi May 13 13:24:19.110631 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: machine: x86_64 May 13 13:24:19.110631 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: clock source: unix May 13 13:24:19.110631 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: pcre jit disabled May 13 13:24:19.110631 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: detected number of CPU cores: 4 May 13 13:24:19.110631 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: current working directory: / May 13 13:24:19.110631 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: detected binary path: /usr/bin/uwsgi-core May 13 13:24:19.111348 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: your processes number limit is 47680 May 13 13:24:19.111348 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: your memory page size is 4096 bytes May 13 13:24:19.111348 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: detected max file descriptor number: 2048 May 13 13:24:19.111348 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: lock engine: pthread robust mutexes May 13 13:24:19.111348 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: thunder lock: enabled May 13 13:24:19.111348 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 13:24:19.111348 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 13:24:19.157142 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: Python main interpreter initialized at 0x55d9af4739c0 May 13 13:24:19.157142 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: python threads support enabled May 13 13:24:19.157142 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: your server socket listen backlog is limited to 100 connections May 13 13:24:19.157142 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: your mercy for graceful operations on workers is 90 seconds May 13 13:24:19.166531 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: mapped 403077 bytes (393 KB) for 2 cores May 13 13:24:19.166531 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: *** Operational MODE: preforking *** May 13 13:24:19.166531 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: *** uWSGI is running in multiple interpreter mode *** May 13 13:24:19.166531 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: spawned uWSGI master process (pid: 117586) May 13 13:24:19.166531 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: spawned uWSGI worker 1 (pid: 117602, cores: 1) May 13 13:24:19.166531 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: spawned uWSGI worker 2 (pid: 117603, cores: 1) May 13 13:24:19.166531 dv-cinder-841591-2-iscsi devstack@n-api.service[117586]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 13:24:19.158113 dv-cinder-841591-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 13:24:20.406746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:24:20.408296 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:24:21.212252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:24:21.212252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: from cryptography.utils import int_from_bytes May 13 13:24:21.212552 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:24:21.212552 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: from cryptography.utils import int_from_bytes May 13 13:24:21.242296 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:24:21.242296 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: from cryptography.utils import int_from_bytes May 13 13:24:21.242743 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:24:21.242743 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: from cryptography.utils import int_from_bytes May 13 13:24:23.669777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:24:23.670401 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:24:23.671164 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:24:23.671481 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:24:23.671752 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:24:23.672151 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.672489 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.672823 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.673156 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.673496 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.673840 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.674178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.674511 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.674863 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.675125 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.675449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.675786 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841591-2-iscsi {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.676119 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.676439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.676762 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.677090 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.677408 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.677742 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.678084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.678595 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.680566 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.681152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.681724 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.682360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.682940 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.683498 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.684078 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.684660 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.685105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.685484 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.685927 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841591-2-iscsi {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.686387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.687191 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.687573 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.688012 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.688341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.688667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.689002 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.689341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.689666 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.690079 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.690455 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.690794 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.691127 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.691445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.691775 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.692096 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.692430 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.692749 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.693068 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.693330 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.693652 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.694008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.694340 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.694673 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.694937 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.695451 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.695784 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.696118 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.696438 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.696756 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.697074 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.697392 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.697711 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.698101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.698373 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.698692 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.699021 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.699348 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.699680 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.699998 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.700328 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.700737 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.700999 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.701323 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.701677 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.702080 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.702403 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.702759 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.703095 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.703314 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:24:23.703730 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.703807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:24:23.703879 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.704081 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.704234 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:24:23.704424 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.704580 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:24:23.704732 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.704887 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:24:23.705033 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.705187 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.705332 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.705476 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.705628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.705839 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.706007 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.706200 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.706355 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.706508 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.706664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.706810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.706961 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.707138 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.707295 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.707441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.707594 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.707768 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.707943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.708100 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.708254 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.708399 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.708550 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.708707 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841591-2-iscsi {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.708867 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.709021 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.709165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.709309 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.709461 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.709606 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.709765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.709970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.710130 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.710285 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.710285 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.710580 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.710736 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.710882 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.711038 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.711189 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.711358 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.711515 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.711704 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.712461 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.712658 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.712820 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.712992 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.713148 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.713301 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.713459 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.713635 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.713813 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.713967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.714111 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.714269 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.714435 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.714595 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.714750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.714907 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.715054 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.715199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.715358 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841591-2-iscsi {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.715513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.715658 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.715810 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.715965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.716144 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.716595 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.716759 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.716913 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.717067 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.717222 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.717382 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.718205 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.718354 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.718511 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.718665 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.718840 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.719001 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.719148 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.719314 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.719468 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.719613 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.719780 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.719934 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.720080 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.720226 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.720371 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.720529 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.720695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.720841 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.720994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.721138 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.721322 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.721474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.721637 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.721834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.722773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.722993 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.723155 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.723312 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.723474 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.723621 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.723773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.723919 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.724083 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.724239 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.724385 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.724539 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.724685 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.724685 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.724965 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.725119 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.725267 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.725413 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.725566 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.725721 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.725931 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.726080 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.726232 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.726378 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.726524 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.726670 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.726824 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.726977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.727131 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.727277 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.727421 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.727575 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.727741 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.727895 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.728050 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.728197 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.728341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.728570 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.728719 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.728871 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.729110 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.729269 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.729422 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.729584 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.729731 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.729981 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.730130 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.730287 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.730440 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.730605 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.730753 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.730907 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.731058 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.731212 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.731365 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.731528 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.731528 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.731818 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.731975 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.732375 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.733025 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.734081 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.734245 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.734655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.734817 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.734977 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.735139 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.735298 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.735452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.735604 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.735762 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.735907 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.736069 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.736222 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.736380 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.736535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.736681 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.736681 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.736971 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.737126 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.737279 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.737433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.737586 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.737742 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.737925 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.738083 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.738236 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.738390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.738542 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.738702 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.738848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.739001 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.739001 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.739295 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.739441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.739595 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.739753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.739906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.740060 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.740584 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.740754 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.740912 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.741059 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.741213 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.741378 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.741534 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.741681 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.741857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.742009 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.742165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.742554 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.743189 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.743356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.743504 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.743658 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.743658 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.743942 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.744094 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.744246 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.744393 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.744544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.744710 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.744882 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.745042 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.745199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.745345 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.745498 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.745644 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.745827 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.745996 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.746143 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.746299 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.746444 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.746679 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.746857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.747019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.747173 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.747319 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.747472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.747620 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.747779 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.747926 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.748070 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.748222 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.748374 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.748528 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.748725 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.748897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.748897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.749174 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.749318 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.749477 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.749640 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.749804 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.749966 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.750112 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.750256 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.750410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.750563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.750709 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.750873 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.751019 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.751171 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.751324 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.751480 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.751641 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.751806 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.751967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.752128 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.752294 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.752678 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:24:23.753150 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.754702 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.754877 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.755044 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.755216 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.755371 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.755524 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.755684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.755845 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.756013 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.756168 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.756329 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.756482 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.756649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.756825 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.756989 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.757151 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.757304 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.757464 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.757624 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.757777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.758103 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.758264 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.758417 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.758683 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.758849 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.759058 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.759235 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.759399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.759561 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.759722 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.759884 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.760122 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.760287 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.760446 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.760605 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.760758 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.760918 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.761084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.761238 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.761406 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.761563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.761727 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.761906 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.762076 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.762230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.762381 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.762552 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.762938 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.763619 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.763782 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.763943 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.764116 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.764280 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.764811 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.764991 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.765143 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.765303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.765464 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.765617 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.765768 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.765962 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.766116 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.766277 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.766429 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.766638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.766792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.766958 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.767128 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.767281 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.767445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.767598 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.767763 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.767923 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.768074 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.768233 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.768386 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.768539 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.768710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.768864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.769015 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.769174 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.769333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.769494 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.769658 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.769847 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.770017 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.770170 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.770320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.770480 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.770647 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.770819 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.770819 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.771116 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.771270 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.771431 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.771597 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.771760 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.771912 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.771912 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.772215 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.772385 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.772537 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.773927 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.774105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.774260 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.774412 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.774585 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.774749 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.774903 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.775054 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.775206 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.775366 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.775658 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.775834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.775996 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.776160 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.776313 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.776472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.776635 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.776788 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.776940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.777100 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.777252 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.777413 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.777567 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.777718 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.777895 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.778061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.778235 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.778402 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.778564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.778726 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.778880 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.778880 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.779185 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.779352 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.779512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.779674 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.779833 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.780497 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.780672 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.780853 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.781012 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.781175 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.781334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.781505 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.781672 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.781852 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.782009 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.782163 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.782316 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.782479 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.782647 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.782821 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.783208 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.783624 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.783789 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.784156 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.784334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.784497 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.784657 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.784817 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.784970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.785249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.785425 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.785586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.785888 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.786061 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.786214 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.786377 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.786529 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.786680 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.786832 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.786984 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.787142 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.787309 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.787462 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.787622 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.787774 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.787941 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.788101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.788269 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.788430 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.788583 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.788742 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.788895 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.789054 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.789217 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.789217 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.789508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.789659 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.789841 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.790146 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.790327 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.790483 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.790635 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.790795 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.790947 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.791108 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.791259 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.791421 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.791575 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.791734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.791894 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.792061 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.792232 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.792385 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.792535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.792687 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.792837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.793003 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.793003 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.793706 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.793706 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.794064 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.794493 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.794493 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.794814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.794973 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.795133 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.795284 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.795450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.795677 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.796418 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.796577 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.796729 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.796888 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.797056 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.797209 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.797361 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.797529 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.797682 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.797852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.798022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.798184 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.798336 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.798336 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.798632 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.798784 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.798949 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.799101 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.799271 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.799271 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.799624 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.799808 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.800470 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.800644 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.800807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.800966 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.801127 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.801302 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.801475 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.801629 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.801815 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.802042 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.802201 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.802373 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.802535 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.802687 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.802853 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.803012 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.803165 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.803526 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.803897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.804063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.804227 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.804619 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.804780 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.804945 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.805105 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.805265 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.805426 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.805580 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.805732 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.805907 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.806072 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.806226 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.806410 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.806632 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.806797 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.806958 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.807121 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.807285 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.807438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.807590 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.807750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.807902 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.808062 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.808223 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.808385 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.808537 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.808689 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.808840 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.808999 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.809171 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.809332 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.809485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.809652 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.809841 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.810010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.810175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.810328 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.810487 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.810649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.810808 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.810971 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.811131 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.811340 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.811499 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.811659 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.811820 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.811982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.812134 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.812284 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.812435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.812587 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.812737 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.812901 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.813054 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.813224 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.813376 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.815061 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.815239 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.815239 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.815565 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.815729 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.815901 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.816064 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.816229 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.816383 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.816534 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.816783 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.817001 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.817158 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.817321 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.817481 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.817641 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.817813 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.817983 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.818144 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.818324 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.818496 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.818657 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.818810 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.818961 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.819142 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.819302 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.819454 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.819613 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.819773 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.819926 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.820345 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.820509 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.820662 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.820820 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.820973 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.821125 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.821290 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.821466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.821627 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.821780 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.821970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.822131 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.822351 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.822623 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.822812 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.822968 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.823205 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.823381 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.824582 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.824752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.824933 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.825318 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.825485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.825654 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.825880 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.826051 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.826214 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.826374 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.826527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.826689 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.826959 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.827118 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.827290 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.827443 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.827594 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.827760 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.827912 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.828065 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.828224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.828224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.828534 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.828696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.828696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.828696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.829186 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.829354 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.829516 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.829677 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.829848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.830017 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.830171 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.830329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.830329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.830632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.830791 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.830944 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.831106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.831266 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.831518 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.831675 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.831834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.832001 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.832153 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.832313 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.832475 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.832627 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.832786 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.832952 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.833104 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.833265 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.833417 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.833588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.833760 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.834387 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.835156 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.836012 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.836188 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.836353 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.836514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.836677 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.836837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.837093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.837274 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.837437 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.837598 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.837762 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.837939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.838107 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.838270 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.838432 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.838586 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.838739 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.838900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.839172 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.839335 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.839510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.839664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.839817 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.839979 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.840140 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.840292 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.840445 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.840604 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.840765 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.840933 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.841094 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.841261 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.841435 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.841588 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.841740 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.841974 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.842137 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.842290 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.842290 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.843103 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.843264 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.843432 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.843586 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.843746 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.843906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.844529 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.844706 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.844861 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.845022 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.845176 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.845176 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.845692 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.845908 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.846076 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.846230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.846389 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.846551 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.846711 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.846888 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.847058 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.847286 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.847675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.847675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.847987 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.848154 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.848318 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.848479 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.848801 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.848973 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.849140 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.849307 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.849477 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.849569 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.849651 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.849738 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.849877 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.849967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.850051 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.850144 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.850240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.850333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.850428 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.850514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.850668 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.850809 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.850940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.851077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.851222 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.851362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.851493 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.851591 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.851677 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.851773 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.851866 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.851960 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.852053 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.852053 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.852219 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.852322 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.852408 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.852492 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.852575 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.852666 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.852758 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.852857 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.852943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.853034 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.853126 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.853218 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.853310 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.853405 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.853492 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.853584 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.853670 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.853762 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.853924 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.854021 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.854106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.854281 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.854685 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.854783 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.854879 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.854972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.855057 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.855141 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.855224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.855308 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.855405 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.855491 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.855583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.855692 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.855973 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.856065 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.856161 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.856247 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.856247 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.856410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.856503 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.856602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.856688 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.856772 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.856855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.856946 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.857032 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.857124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.857210 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.857309 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.857395 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.857479 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.857562 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.857659 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.857746 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.857876 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.857966 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.858074 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.858202 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.858799 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.858895 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.858980 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.859183 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.859283 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.859381 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.859475 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.859561 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.859652 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.859737 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.859820 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.859918 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.859918 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.860072 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.860157 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.860240 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.860331 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.860428 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.860514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.860606 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.860692 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.860775 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.860775 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.860945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.861038 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.861125 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.861215 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.861307 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.861401 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.861487 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.861571 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.861655 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.861655 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.861841 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.861939 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.862025 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.862109 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.862193 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.862193 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.862346 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.862443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.862543 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.862543 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.862709 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.862797 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.862881 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.863038 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.863126 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.863219 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.863304 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.863388 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.863481 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.863567 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.863659 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.863745 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.863829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.863913 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.864006 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.864093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.864184 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.864270 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.864400 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.864501 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.864826 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.864924 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.865009 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.865102 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.865188 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.865280 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.865389 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.865496 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.865496 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.865670 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.865769 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.865941 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.866217 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.866303 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.866401 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.866494 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.866638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.866732 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.866826 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.866912 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.866996 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.867096 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.867184 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.867269 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.867361 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.867453 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.867545 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.867645 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.867732 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.867824 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.867910 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.868000 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.868094 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.868189 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.868275 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.868367 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.868460 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.868546 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.868637 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.868736 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.868831 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.868923 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.869016 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.869108 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.869223 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.869318 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.869318 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.869475 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.869559 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.869649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.869649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.869841 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.869841 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.870000 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.870091 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.870177 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.870274 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.870368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.870462 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.870547 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.870638 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.870724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.870817 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.870903 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.870982 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.871062 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.871154 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.871249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.871336 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.871428 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.871520 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.871594 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.871666 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.871755 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.871837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.871917 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.871995 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872146 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872232 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872386 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872457 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872527 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872599 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872757 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872837 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872910 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.872983 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873214 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873286 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873364 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873443 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873524 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873605 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873701 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873779 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873882 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873964 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.873964 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.874111 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.874184 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.874262 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.874342 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.874414 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.874414 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.874553 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.874625 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.874965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.875061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.875151 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.875232 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.875305 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.875376 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.875447 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.875526 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.875674 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.875759 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.875839 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.875919 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.875999 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.876071 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.876361 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.876449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.876522 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.876593 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.876674 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.876674 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.876817 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.876896 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.876976 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.877055 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.877135 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.877221 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.877301 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.877374 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.877452 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.877532 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.877604 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.877691 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.877691 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.877691 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.877691 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878006 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878090 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878164 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878307 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878378 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878456 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878538 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878611 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878775 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878854 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.878933 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.879014 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.879230 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.879348 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.879538 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.879633 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.879867 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.879972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.880194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.880289 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.880520 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.880613 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.880846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.880942 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.881166 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.881265 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.881513 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.881616 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.881875 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.881973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.882202 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.882530 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.883363 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.883476 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.883576 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.883664 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.883745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.883886 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.884060 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.884170 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.884396 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.884498 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.884719 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.884827 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.885139 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.885257 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.885360 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.885446 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.885647 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.885754 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.886026 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.886149 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.886304 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.886414 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.886621 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.886749 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.886938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.887059 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.887248 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.887353 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.887570 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.887662 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.887890 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.887991 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.888208 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.888302 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.888521 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.888614 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.888839 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.888934 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.889155 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.889410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.889537 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.889772 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.889956 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.890132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.890297 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.890471 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.890630 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.890807 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.890964 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.891136 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.891308 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.891456 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.891632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.891792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.891967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.892111 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.892296 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.892430 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.892623 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.892763 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.892951 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.893085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.893278 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.893400 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.893603 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.893711 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.893954 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.894064 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.894283 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.894378 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.894603 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.894706 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.894931 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.895039 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.895292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.895380 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.895574 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.895670 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.895897 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.896138 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.896242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.896475 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.896585 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.896802 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.896917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.897127 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.897277 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.897441 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.897560 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.897756 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.897881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.898101 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.898216 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.898423 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.898533 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.898736 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.898828 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.899054 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.899153 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.899367 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.899467 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.899690 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.899792 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.900005 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.900098 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.900328 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.900421 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.900668 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.900768 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.900994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.901095 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.901307 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.901400 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.901625 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.901726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.901972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.902078 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.902302 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.902394 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.902644 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.902738 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.902957 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.903114 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.903277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.903370 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.903617 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.903727 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.903925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.904033 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.904248 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.904542 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.904641 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.904878 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.905514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.905723 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.905957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.906091 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.906238 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.906388 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.906556 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.906708 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.906870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.907012 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.907192 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.907332 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.907512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.907673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.907849 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.908003 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.908173 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.908327 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.908495 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.908654 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.908818 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.908981 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.909140 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.909477 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.909581 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.909800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.909913 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.910134 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.910228 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.910455 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.910550 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.910776 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.910871 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.911098 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.911193 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.911418 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.911514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.911737 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.911839 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.912063 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.912204 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.912379 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.912501 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.912699 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.912803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.913019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.913126 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.913335 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.913436 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.913667 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.913761 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.914024 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.914133 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.914342 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.914442 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.914662 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.914758 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.914978 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.915071 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.915304 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.915521 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.915767 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.915915 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.916023 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.916197 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.916343 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.916537 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.916677 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.916873 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.917003 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.917202 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.917321 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.917545 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.917677 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.917906 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.918067 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.918225 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.918402 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.918542 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.918739 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.918869 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.919065 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.919191 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.919399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.919493 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.919748 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.919856 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.920087 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.920182 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.920419 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.920518 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.921283 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.921402 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.921605 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.921707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.921945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.922042 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.922300 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.922408 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.922619 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.922761 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.922974 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.923067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.923288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.923755 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.923755 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.923942 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.924037 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.924123 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.924223 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.924310 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.924517 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.924619 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.924834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.924937 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.925151 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.925255 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.925466 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.925568 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.925800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.925963 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.926131 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.926274 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.926445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.926556 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.926757 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.926859 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.927071 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.927164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.927386 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.927480 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.927700 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.927845 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.928014 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.928109 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.928334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.928428 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.928650 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.928753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.928966 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.929060 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.929313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.929422 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.929691 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.929816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.930056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.930163 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.930399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.930502 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.930727 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.930821 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.931142 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.931304 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.931529 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.931652 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.931910 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.932005 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.932245 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.932348 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.932593 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.932696 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.932929 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.933025 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.933241 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.933341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.933558 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.933662 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.933903 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.934013 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.934248 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.934343 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.934566 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.934742 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.934885 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.934980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.935203 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.935304 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.935521 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.935628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.935882 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.935988 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.936153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.936284 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.936616 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.936714 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.936808 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.936903 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.937103 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.937197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.937421 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.937524 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.937738 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.937863 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.938084 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.938187 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.938426 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.938520 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.938752 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.938853 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.939077 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.939183 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.939406 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.939529 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.939732 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.940060 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.940176 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.940383 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.940481 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.940708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.940810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.941027 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.941141 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.941356 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.941467 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.941680 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.941799 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.942045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.942156 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.942367 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.942467 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.942678 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.942778 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.943036 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.943137 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.943395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.943496 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.943720 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.943821 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.944051 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.944151 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.944374 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.944474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.944704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.944798 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.945025 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.945382 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.945596 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.945691 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.945873 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:24:23.945996 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.946262 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.946600 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.946948 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.947287 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.947624 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.948007 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.948296 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.948568 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.948890 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.949219 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.949538 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.949891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.950210 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.950530 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.950846 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.951163 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.951482 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.951813 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.952138 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.952450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.952761 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.953075 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.953388 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.953700 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.954036 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.954357 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.954671 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.954986 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.955299 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.955611 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.955923 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.956266 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.956610 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.956934 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.957266 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.957588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.957943 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.958265 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.958597 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.958928 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.959254 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.959574 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.959917 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.960238 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.960559 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.960908 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.961265 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.962001 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.962327 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.962699 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.963035 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.963352 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.963785 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.964126 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.964555 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.964786 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.965125 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.965455 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.965800 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.966136 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.966467 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.966794 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.967121 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.967967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.968311 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.968667 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.969012 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.969334 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.969705 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.970070 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.970169 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_db.sqlalchemy.engines [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:24:23.970433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.970760 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.971117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.971462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.971786 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.972108 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.972436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:24:23.972677 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:24:23.996452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_db.sqlalchemy.engines [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:24:24.035366 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.context [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6cb824f0-0b0e-46be-89c3-2da60fc44ef7(cell1) {{(pid=117603) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:24:24.039975 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:24.041629 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:24.042474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:24.044417 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:24.056150 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_db.sqlalchemy.engines [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:24:24.058042 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_db.sqlalchemy.engines [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:24:24.062138 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.context [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6cb824f0-0b0e-46be-89c3-2da60fc44ef7(cell1) {{(pid=117602) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:24:24.066554 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:24.068183 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:24.068992 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:24:24.071282 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:24:24.083848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_db.sqlalchemy.engines [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:24:24.086019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_db.sqlalchemy.engines [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:24:24.219774 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_db.sqlalchemy.engines [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:24:24.244795 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_db.sqlalchemy.engines [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:24:24.545069 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: WARNING keystonemiddleware.auth_token [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:24:24.553225 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: WARNING keystonemiddleware.auth_token [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:24:24.571037 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: WARNING keystonemiddleware.auth_token [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:24:24.578723 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: WARNING keystonemiddleware.auth_token [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:24:24.904313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: WARNING keystonemiddleware.auth_token [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:24:24.910711 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: WARNING keystonemiddleware.auth_token [None req-f7392d7a-93f1-4960-a1a0-fd9c89b202bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:24:24.916364 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d9af4739c0 pid: 117603 (default app) May 13 13:24:24.923632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: WARNING keystonemiddleware.auth_token [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:24:24.929763 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: WARNING keystonemiddleware.auth_token [None req-2c8e0571-dbb4-4913-92ca-bf46787cd0c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:24:24.935087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d9af4739c0 pid: 117602 (default app) May 13 13:25:07.612687 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b3ea71da-14f3-4b76-a47e-03efabb0d078 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Action: 'create', calling method: .version_select at 0x7faaa3dcc280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1816212319", "metadata": {"Type": "work"}}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b3ea71da-14f3-4b76-a47e-03efabb0d078 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Request method failure captured: May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 122 May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflwyq436_I2WrqpyrEgW6YZUxJRxFSghTahbfDYBrUV-C74JeN8iRHoRs-8siiKd2ScxBC1ZYKdZIZBcLl2_b8bVdrUVV4jowE_dDsArgqHV0-oVeaZbgjF7mLZrUrRRsiH7-izU5P0aRFNOuY3sz-cbC-WYqO1PSyA9176dgZ06UqY May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 942433b7b354400a95fdfe5614773495 May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesNegativeTest-469223586 May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:25:07.642167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/942433b7b354400a95fdfe5614773495"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_942433b7b354400a95fdfe5614773495", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/942433b7b354400a95fdfe5614773495"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/942433b7b354400a95fdfe5614773495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesNegativeTest-469223586 May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 942433b7b354400a95fdfe5614773495 May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesNegativeTest-469223586 May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesNegativeTest-469223586-project May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: b2cef0271718458190ef8c36325c1850 May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesNegativeTest-469223586-project May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1816212319", "metadata": {"Type": "work"}}} May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: May 13 13:25:07.643846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1816212319', 'metadata': {'Type': 'work'}}}} May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise error May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi '#$%' May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:25:07.644852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 13:25:07.646508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 13:25:07.648470 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 13:25:07.648470 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.648470 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b3ea71da-14f3-4b76-a47e-03efabb0d078 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:25:07.648470 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b3ea71da-14f3-4b76-a47e-03efabb0d078 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.256056 May 13 13:25:07.648470 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Fri May 13 13:25:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 13:25:07.866152 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9d5d2951-0db3-4993-9b97-e7b5397e3fc3 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Action: 'create', calling method: .version_select at 0x7faaa3df5ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1818113749", "metadata": {"Type": "work"}}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9d5d2951-0db3-4993-9b97-e7b5397e3fc3 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Request method failure captured: May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 120 May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflwyq436_I2WrqpyrEgW6YZUxJRxFSghTahbfDYBrUV-C74JeN8iRHoRs-8siiKd2ScxBC1ZYKdZIZBcLl2_b8bVdrUVV4jowE_dDsArgqHV0-oVeaZbgjF7mLZrUrRRsiH7-izU5P0aRFNOuY3sz-cbC-WYqO1PSyA9176dgZ06UqY May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 942433b7b354400a95fdfe5614773495 May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-VolumesNegativeTest-469223586 May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:25:07.873824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/942433b7b354400a95fdfe5614773495"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_942433b7b354400a95fdfe5614773495", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/942433b7b354400a95fdfe5614773495"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/942433b7b354400a95fdfe5614773495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-VolumesNegativeTest-469223586 May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 942433b7b354400a95fdfe5614773495 May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-VolumesNegativeTest-469223586 May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-VolumesNegativeTest-469223586-project May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: b2cef0271718458190ef8c36325c1850 May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-VolumesNegativeTest-469223586-project May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1818113749", "metadata": {"Type": "work"}}} May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: May 13 13:25:07.875466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1818113749', 'metadata': {'Type': 'work'}}}} May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise error May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi '0' May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:25:07.876316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 13:25:07.877695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 13:25:07.879067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 13:25:07.879067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:07.879067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9d5d2951-0db3-4993-9b97-e7b5397e3fc3 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:25:07.879067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-9d5d2951-0db3-4993-9b97-e7b5397e3fc3 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.216630 May 13 13:25:07.879067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 1/2] 10.222.0.25 () {60 vars in 1155 bytes} [Fri May 13 13:25:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 219 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 13:25:07.883000 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7d2d0f15-8f22-4859-9ea8-d7b60aad40fb tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Action: 'create', calling method: .version_select at 0x7faaa3c615e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-674764727", "metadata": {"Type": "work"}}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7d2d0f15-8f22-4859-9ea8-d7b60aad40fb tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Request method failure captured: May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 118 May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflwyq436_I2WrqpyrEgW6YZUxJRxFSghTahbfDYBrUV-C74JeN8iRHoRs-8siiKd2ScxBC1ZYKdZIZBcLl2_b8bVdrUVV4jowE_dDsArgqHV0-oVeaZbgjF7mLZrUrRRsiH7-izU5P0aRFNOuY3sz-cbC-WYqO1PSyA9176dgZ06UqY May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 942433b7b354400a95fdfe5614773495 May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesNegativeTest-469223586 May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:25:07.885969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/942433b7b354400a95fdfe5614773495"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_942433b7b354400a95fdfe5614773495", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/942433b7b354400a95fdfe5614773495"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/942433b7b354400a95fdfe5614773495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesNegativeTest-469223586 May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 942433b7b354400a95fdfe5614773495 May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesNegativeTest-469223586 May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesNegativeTest-469223586-project May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: b2cef0271718458190ef8c36325c1850 May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesNegativeTest-469223586-project May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-674764727", "metadata": {"Type": "work"}}} May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: May 13 13:25:07.887522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-674764727', 'metadata': {'Type': 'work'}}}} May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise error May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi '' May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:25:07.888478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 13:25:07.889936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 13:25:07.891263 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 13:25:07.891263 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:07.891263 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7d2d0f15-8f22-4859-9ea8-d7b60aad40fb tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:25:07.891263 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7d2d0f15-8f22-4859-9ea8-d7b60aad40fb tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008322 May 13 13:25:07.893286 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1155 bytes} [Fri May 13 13:25:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 13:25:07.898790 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-55f0c592-46ff-4372-b952-8112656d2b4f tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Calling method '.version_select at 0x7faaa3cb71f0>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:09.253062 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-55f0c592-46ff-4372-b952-8112656d2b4f tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] HTTP exception thrown: Volume tempest-invalid-173727389 could not be found. May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-55f0c592-46ff-4372-b952-8112656d2b4f tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Request method failure captured: May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-173727389 HTTP/1.1 May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflwyq436_I2WrqpyrEgW6YZUxJRxFSghTahbfDYBrUV-C74JeN8iRHoRs-8siiKd2ScxBC1ZYKdZIZBcLl2_b8bVdrUVV4jowE_dDsArgqHV0-oVeaZbgjF7mLZrUrRRsiH7-izU5P0aRFNOuY3sz-cbC-WYqO1PSyA9176dgZ06UqY May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 942433b7b354400a95fdfe5614773495 May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-VolumesNegativeTest-469223586 May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:25:09.258153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/942433b7b354400a95fdfe5614773495"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_942433b7b354400a95fdfe5614773495", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/942433b7b354400a95fdfe5614773495"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/942433b7b354400a95fdfe5614773495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-VolumesNegativeTest-469223586 May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 942433b7b354400a95fdfe5614773495 May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-VolumesNegativeTest-469223586 May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-VolumesNegativeTest-469223586-project May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: b2cef0271718458190ef8c36325c1850 May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-VolumesNegativeTest-469223586-project May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Volume tempest-invalid-173727389 could not be found. May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': 'tempest-invalid-173727389'} May 13 13:25:09.259773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-173727389 could not be found. (HTTP 404) (Request-ID: req-18333d7c-5fa4-4931-87c8-a89df8b66165) May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:09.260724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:25:09.262949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-173727389 could not be found. May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:25:09.264258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-173727389 could not be found. May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-173727389 could not be found. May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-55f0c592-46ff-4372-b952-8112656d2b4f tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Returning 404 to user: Volume tempest-invalid-173727389 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-55f0c592-46ff-4372-b952-8112656d2b4f tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-173727389" status: 404 len: 98 microversion: 2.1 time: 1.374015 May 13 13:25:09.272478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1214 bytes} [Fri May 13 13:25:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-173727389 => generated 98 bytes in 1375 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 13 13:25:09.289730 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a431894d-ca85-4a7a-b8be-d37b1b613b57 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007202 May 13 13:25:09.294605 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1139 bytes} [Fri May 13 13:25:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 13:25:09.302420 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-bb712508-2e66-4b3c-9cce-19919e160218 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005845 May 13 13:25:09.309601 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1136 bytes} [Fri May 13 13:25:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 13:25:09.313361 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5b60422c-c129-43d0-a4e6-e338662f26c2 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Calling method '.version_select at 0x7faaa475d430>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:09.829185 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-5b60422c-c129-43d0-a4e6-e338662f26c2 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] HTTP exception thrown: Volume db0e851d-0a5b-4454-8e87-300c008a9146 could not be found. May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5b60422c-c129-43d0-a4e6-e338662f26c2 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Request method failure captured: May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/os-volumes/db0e851d-0a5b-4454-8e87-300c008a9146 HTTP/1.1 May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflwyq436_I2WrqpyrEgW6YZUxJRxFSghTahbfDYBrUV-C74JeN8iRHoRs-8siiKd2ScxBC1ZYKdZIZBcLl2_b8bVdrUVV4jowE_dDsArgqHV0-oVeaZbgjF7mLZrUrRRsiH7-izU5P0aRFNOuY3sz-cbC-WYqO1PSyA9176dgZ06UqY May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 942433b7b354400a95fdfe5614773495 May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesNegativeTest-469223586 May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:25:09.836334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/942433b7b354400a95fdfe5614773495"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_942433b7b354400a95fdfe5614773495", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/942433b7b354400a95fdfe5614773495"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/942433b7b354400a95fdfe5614773495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesNegativeTest-469223586 May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 942433b7b354400a95fdfe5614773495 May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesNegativeTest-469223586 May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesNegativeTest-469223586-project May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: b2cef0271718458190ef8c36325c1850 May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesNegativeTest-469223586-project May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Volume db0e851d-0a5b-4454-8e87-300c008a9146 could not be found. May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'db0e851d-0a5b-4454-8e87-300c008a9146'} May 13 13:25:09.841013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume db0e851d-0a5b-4454-8e87-300c008a9146 could not be found. (HTTP 404) (Request-ID: req-26db052c-c34d-4ace-a4c4-9e8b16c7c4ed) May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:09.841870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:25:09.844320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume db0e851d-0a5b-4454-8e87-300c008a9146 could not be found. May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 13:25:09.845510 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume db0e851d-0a5b-4454-8e87-300c008a9146 could not be found. May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume db0e851d-0a5b-4454-8e87-300c008a9146 could not be found. May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5b60422c-c129-43d0-a4e6-e338662f26c2 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Returning 404 to user: Volume db0e851d-0a5b-4454-8e87-300c008a9146 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5b60422c-c129-43d0-a4e6-e338662f26c2 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/db0e851d-0a5b-4454-8e87-300c008a9146" status: 404 len: 109 microversion: 2.1 time: 0.529589 May 13 13:25:09.847777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1247 bytes} [Fri May 13 13:25:09 2022] DELETE /compute/v2.1/os-volumes/db0e851d-0a5b-4454-8e87-300c008a9146 => generated 109 bytes in 531 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:25:09.848777 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4a5ee154-0d1c-45af-8585-d0c35d4d7260 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Calling method '.version_select at 0x7faaa3bfff70>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:10.140970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-4a5ee154-0d1c-45af-8585-d0c35d4d7260 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] HTTP exception thrown: Volume c913d8fa-34d4-4dca-9d20-275d9f07867e could not be found. May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4a5ee154-0d1c-45af-8585-d0c35d4d7260 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Request method failure captured: May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/os-volumes/c913d8fa-34d4-4dca-9d20-275d9f07867e HTTP/1.1 May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflwyq436_I2WrqpyrEgW6YZUxJRxFSghTahbfDYBrUV-C74JeN8iRHoRs-8siiKd2ScxBC1ZYKdZIZBcLl2_b8bVdrUVV4jowE_dDsArgqHV0-oVeaZbgjF7mLZrUrRRsiH7-izU5P0aRFNOuY3sz-cbC-WYqO1PSyA9176dgZ06UqY May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 942433b7b354400a95fdfe5614773495 May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-VolumesNegativeTest-469223586 May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:25:10.143631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/942433b7b354400a95fdfe5614773495"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_942433b7b354400a95fdfe5614773495", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/942433b7b354400a95fdfe5614773495"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/942433b7b354400a95fdfe5614773495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-VolumesNegativeTest-469223586 May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 942433b7b354400a95fdfe5614773495 May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-VolumesNegativeTest-469223586 May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-VolumesNegativeTest-469223586-project May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: b2cef0271718458190ef8c36325c1850 May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-VolumesNegativeTest-469223586-project May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Volume c913d8fa-34d4-4dca-9d20-275d9f07867e could not be found. May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': 'c913d8fa-34d4-4dca-9d20-275d9f07867e'} May 13 13:25:10.144977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c913d8fa-34d4-4dca-9d20-275d9f07867e could not be found. (HTTP 404) (Request-ID: req-0b5bd20d-d618-4873-98b8-94306ffae437) May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:10.145833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:25:10.147043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c913d8fa-34d4-4dca-9d20-275d9f07867e could not be found. May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 13:25:10.148160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:25:10.149458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c913d8fa-34d4-4dca-9d20-275d9f07867e could not be found. May 13 13:25:10.149458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:10.149458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:25:10.149458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:10.149458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:25:10.149458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:25:10.149458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:25:10.149458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:25:10.149458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:25:10.149458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c913d8fa-34d4-4dca-9d20-275d9f07867e could not be found. May 13 13:25:10.149458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:25:10.164372 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4a5ee154-0d1c-45af-8585-d0c35d4d7260 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] Returning 404 to user: Volume c913d8fa-34d4-4dca-9d20-275d9f07867e could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:25:10.166430 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4a5ee154-0d1c-45af-8585-d0c35d4d7260 tempest-VolumesNegativeTest-469223586 tempest-VolumesNegativeTest-469223586-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c913d8fa-34d4-4dca-9d20-275d9f07867e" status: 404 len: 109 microversion: 2.1 time: 0.322502 May 13 13:25:10.183248 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:25:09 2022] GET /compute/v2.1/os-volumes/c913d8fa-34d4-4dca-9d20-275d9f07867e => generated 109 bytes in 334 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:25:11.884210 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1451738524", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "networks": [{"uuid": "371011cc-fae8-48c0-8a92-ac7c80ac3095"}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:12.093449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] validate_networks() for [('371011cc-fae8-48c0-8a92-ac7c80ac3095', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:25:13.645262 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:25:13.645877 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:25:13.646533 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:25:13.647239 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:25:13.648003 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:25:13.699849 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:13.702970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:13.705513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:13.709296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:13.806707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Getting quotas for project 65563e9192834a848521c69c7c80f078. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:25:13.823531 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Getting quotas for user 80623f3527844489a5e31a786080fa10 and project 65563e9192834a848521c69c7c80f078. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:25:13.843622 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:25:13.846955 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:25:14.118274 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3ccfe3d6-41a6-49cc-8aa5-809624525f47 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.420076 May 13 13:25:14.127078 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 5/9] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:25:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:25:14.134245 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-35910c0b-d703-46e8-9bb0-fd10f245ffc9 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:14.140091 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-35910c0b-d703-46e8-9bb0-fd10f245ffc9 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:14.413416 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-35910c0b-d703-46e8-9bb0-fd10f245ffc9 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:14.455489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-35910c0b-d703-46e8-9bb0-fd10f245ffc9 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1215 microversion: 2.1 time: 0.328010 May 13 13:25:14.456077 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 5/10] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:14 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1215 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:15.487376 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1d317aa4-0759-47df-ad36-82fab7c2438b tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:15.489978 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1d317aa4-0759-47df-ad36-82fab7c2438b tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:15.759979 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1d317aa4-0759-47df-ad36-82fab7c2438b tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:15.785405 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1d317aa4-0759-47df-ad36-82fab7c2438b tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1215 microversion: 2.1 time: 0.313914 May 13 13:25:15.790602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:15 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1215 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:16.810231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b0b17eed-5b13-4cd9-8c15-20ff3791c917 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:16.810848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b0b17eed-5b13-4cd9-8c15-20ff3791c917 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:17.084205 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b0b17eed-5b13-4cd9-8c15-20ff3791c917 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:17.097240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b0b17eed-5b13-4cd9-8c15-20ff3791c917 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1215 microversion: 2.1 time: 0.290977 May 13 13:25:17.100288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:16 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1215 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:18.116579 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-940590b5-ee46-4ac3-978b-28dc628a08fb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:18.117313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-940590b5-ee46-4ac3-978b-28dc628a08fb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:18.126161 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-940590b5-ee46-4ac3-978b-28dc628a08fb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:18.130187 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-940590b5-ee46-4ac3-978b-28dc628a08fb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:18.131185 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-940590b5-ee46-4ac3-978b-28dc628a08fb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:18.131498 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-940590b5-ee46-4ac3-978b-28dc628a08fb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:18.499705 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-940590b5-ee46-4ac3-978b-28dc628a08fb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:18.520884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-940590b5-ee46-4ac3-978b-28dc628a08fb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1219 microversion: 2.1 time: 0.408153 May 13 13:25:18.524265 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:18 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1219 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:19.545423 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7629adc3-360d-4767-bda8-efb48b29e91c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:19.546257 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7629adc3-360d-4767-bda8-efb48b29e91c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:19.559083 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7629adc3-360d-4767-bda8-efb48b29e91c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:19.561451 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7629adc3-360d-4767-bda8-efb48b29e91c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:19.564855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7629adc3-360d-4767-bda8-efb48b29e91c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:19.566802 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7629adc3-360d-4767-bda8-efb48b29e91c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:19.936280 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-7629adc3-360d-4767-bda8-efb48b29e91c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:19.948591 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7629adc3-360d-4767-bda8-efb48b29e91c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1211 microversion: 2.1 time: 0.408847 May 13 13:25:19.950620 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 7/14] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:19 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1211 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:20.875553 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-77119ef6-5435-42b0-a730-9c6bdf6aaa0f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Action: 'create', calling method: .version_select at 0x7faaa29e4160>, body: {"keypair": {"name": "tempest-keypair-1930936376", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG2h1sF/Mu2/4WYhrz4uUNWWnm/xByzvo5LwzJb+iLYTjrhBttX4FmhHHpYPCKNXePsSqIC/pAen2Ivc+fypHYyq0sE+in+8jKmOjT4Rzz4dGbfnB+Ck3sPyEkETiajlQ=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:20.906676 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-77119ef6-5435-42b0-a730-9c6bdf6aaa0f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Getting quotas for project 4cd4aa315c4340a1a649d8c51cea0da9. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:25:20.921743 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-77119ef6-5435-42b0-a730-9c6bdf6aaa0f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Getting quotas for user 08b9fbf87cfa417fbea857ae602a140e and project 4cd4aa315c4340a1a649d8c51cea0da9. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:25:20.968827 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-faee0d6a-afc2-47cd-a0cb-43aad9921614 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:20.969961 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-faee0d6a-afc2-47cd-a0cb-43aad9921614 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:20.980839 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-faee0d6a-afc2-47cd-a0cb-43aad9921614 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:20.988996 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-faee0d6a-afc2-47cd-a0cb-43aad9921614 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:20.989995 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-faee0d6a-afc2-47cd-a0cb-43aad9921614 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:20.990704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-faee0d6a-afc2-47cd-a0cb-43aad9921614 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:21.119379 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-77119ef6-5435-42b0-a730-9c6bdf6aaa0f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.515388 May 13 13:25:21.127110 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 8/15] 10.222.0.25 () {62 vars in 1199 bytes} [Fri May 13 13:25:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 524 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 13 13:25:21.808119 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-faee0d6a-afc2-47cd-a0cb-43aad9921614 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:21.823166 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-faee0d6a-afc2-47cd-a0cb-43aad9921614 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1211 microversion: 2.1 time: 0.860505 May 13 13:25:21.831519 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:20 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1211 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:22.845474 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7dba07fa-1a24-4b2a-b401-76cac5ff99d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:22.849010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7dba07fa-1a24-4b2a-b401-76cac5ff99d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:22.889776 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7dba07fa-1a24-4b2a-b401-76cac5ff99d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:22.895515 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7dba07fa-1a24-4b2a-b401-76cac5ff99d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:22.896740 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7dba07fa-1a24-4b2a-b401-76cac5ff99d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:22.902347 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7dba07fa-1a24-4b2a-b401-76cac5ff99d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:23.071863 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1443546280", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:23.211787 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] validate_networks() for [('ac9a1bdf-5ea7-4967-be4e-67b8e1ea2be2', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:25:23.337265 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-7dba07fa-1a24-4b2a-b401-76cac5ff99d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:23.354706 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7dba07fa-1a24-4b2a-b401-76cac5ff99d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1273 microversion: 2.1 time: 0.517655 May 13 13:25:23.358668 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 9/17] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:22 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1273 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:24.298821 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ea705aaa-1779-43f9-b5a5-e92d33228e97 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Action: 'create', calling method: .version_select at 0x7faaa3ae7700>, body: {"keypair": {"name": "tempest-keypair-1155574201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWVo+cJotl1WxxeWDoVAPnr4MkyK2i4fVhy8hFNzquwqwkKvmwz1zm07nmtlwV6osWA/fvJ90tmJCny7ZFllrW/Aw3WInvvJ/+vhb9Igj+ncjEq/zfTsDGJG0r5DkIotg=="}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:24.492514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-ea705aaa-1779-43f9-b5a5-e92d33228e97 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Getting quotas for project 915a7ff1f6d64480a08c38e762da4134. Resources: {'key_pairs'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:25:24.524412 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-ea705aaa-1779-43f9-b5a5-e92d33228e97 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Getting quotas for user 233f5342cf334c7689cb9e71f4fbaab3 and project 915a7ff1f6d64480a08c38e762da4134. Resources: {'key_pairs'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:25:24.780294 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ea705aaa-1779-43f9-b5a5-e92d33228e97 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.740062 May 13 13:25:24.780981 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 10/18] 10.222.0.25 () {60 vars in 1158 bytes} [Fri May 13 13:25:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:25:24.793251 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-fe4e0511-8619-42c1-90f4-37c52c5387e3 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:24.800522 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-fe4e0511-8619-42c1-90f4-37c52c5387e3 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:24.834961 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fe4e0511-8619-42c1-90f4-37c52c5387e3 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:24.836675 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fe4e0511-8619-42c1-90f4-37c52c5387e3 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:24.837617 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fe4e0511-8619-42c1-90f4-37c52c5387e3 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:24.844398 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fe4e0511-8619-42c1-90f4-37c52c5387e3 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:24.883469 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:25:24.884628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:25:24.888227 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:25:24.888227 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:25:24.888227 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:25:24.905279 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:24.917252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:24.919903 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:24.920589 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:24.991792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Getting quotas for project e25902914d244bfeaa038f24838c28ca. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:25:25.013134 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Getting quotas for user f56c908ada31445e85ec1dfee8e2ebdb and project e25902914d244bfeaa038f24838c28ca. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:25:25.061356 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:25:25.063972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:25:25.092469 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-fe4e0511-8619-42c1-90f4-37c52c5387e3 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:25.108909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-fe4e0511-8619-42c1-90f4-37c52c5387e3 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1273 microversion: 2.1 time: 0.320781 May 13 13:25:25.114027 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 11/19] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:24 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1273 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:25.251929 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-aa2e3f33-581e-4eb0-8009-e340b1494337 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.458247 May 13 13:25:25.257527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 9/20] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:25:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:25:25.272111 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-78309b89-436a-4e9d-a29a-193662ebb4eb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:25.272933 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-78309b89-436a-4e9d-a29a-193662ebb4eb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:25.915284 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-78309b89-436a-4e9d-a29a-193662ebb4eb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:25.923450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-78309b89-436a-4e9d-a29a-193662ebb4eb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1222 microversion: 2.1 time: 0.656931 May 13 13:25:25.942080 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 12/21] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:25 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1222 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:26.125014 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-133333872", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:26.130763 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4bc225b7-6bbb-441a-b5c6-25f9b45bac19 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:26.131496 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-4bc225b7-6bbb-441a-b5c6-25f9b45bac19 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:26.143560 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4bc225b7-6bbb-441a-b5c6-25f9b45bac19 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:26.144020 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4bc225b7-6bbb-441a-b5c6-25f9b45bac19 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:26.144903 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4bc225b7-6bbb-441a-b5c6-25f9b45bac19 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:26.145387 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4bc225b7-6bbb-441a-b5c6-25f9b45bac19 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:26.260480 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] validate_networks() for [('ac9a1bdf-5ea7-4967-be4e-67b8e1ea2be2', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:25:26.603256 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-4bc225b7-6bbb-441a-b5c6-25f9b45bac19 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:26.617748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4bc225b7-6bbb-441a-b5c6-25f9b45bac19 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.491172 May 13 13:25:26.619728 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 13/22] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:26 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:27.380594 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:25:27.381138 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:25:27.381646 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:25:27.382178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:25:27.382670 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:25:27.393111 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:27.393978 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:27.394905 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:27.395423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:27.418503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Getting quotas for project e25902914d244bfeaa038f24838c28ca. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:25:27.423420 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Getting quotas for user f56c908ada31445e85ec1dfee8e2ebdb and project e25902914d244bfeaa038f24838c28ca. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:25:27.441631 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:25:27.444332 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:25:27.636499 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-85a92937-eeed-4cfa-9b16-f0254b311402 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:27.637209 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-85a92937-eeed-4cfa-9b16-f0254b311402 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:27.643593 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-85a92937-eeed-4cfa-9b16-f0254b311402 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:27.644054 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-85a92937-eeed-4cfa-9b16-f0254b311402 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:27.644841 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-85a92937-eeed-4cfa-9b16-f0254b311402 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:27.645283 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-85a92937-eeed-4cfa-9b16-f0254b311402 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:27.865817 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7258c075-5d1e-4fae-a358-e1930fa248d7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.758234 May 13 13:25:27.866655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 10/23] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:25:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:25:27.892149 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-85a92937-eeed-4cfa-9b16-f0254b311402 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:27.908579 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-88b04920-6b75-4f30-881f-e341dea97e30 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:27.913128 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-88b04920-6b75-4f30-881f-e341dea97e30 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:27.919711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-85a92937-eeed-4cfa-9b16-f0254b311402 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.284969 May 13 13:25:27.921702 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 14/24] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:27 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:28.373517 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-88b04920-6b75-4f30-881f-e341dea97e30 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:28.395435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-88b04920-6b75-4f30-881f-e341dea97e30 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1221 microversion: 2.1 time: 0.515870 May 13 13:25:28.398413 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 11/25] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:27 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1221 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:28.947374 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7134721b-bf57-459b-9f14-95c43c6f6045 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:28.948099 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7134721b-bf57-459b-9f14-95c43c6f6045 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:28.966602 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7134721b-bf57-459b-9f14-95c43c6f6045 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:28.967068 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7134721b-bf57-459b-9f14-95c43c6f6045 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:28.967871 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7134721b-bf57-459b-9f14-95c43c6f6045 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:28.968317 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7134721b-bf57-459b-9f14-95c43c6f6045 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:29.416314 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f02315ee-784e-4708-b4c5-b63fae19dd43 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:29.433158 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f02315ee-784e-4708-b4c5-b63fae19dd43 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:29.772762 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f02315ee-784e-4708-b4c5-b63fae19dd43 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:29.787850 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f02315ee-784e-4708-b4c5-b63fae19dd43 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1221 microversion: 2.1 time: 0.376714 May 13 13:25:29.792226 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 12/26] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:29 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1221 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:29.820775 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-7134721b-bf57-459b-9f14-95c43c6f6045 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:29.832863 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7134721b-bf57-459b-9f14-95c43c6f6045 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.893735 May 13 13:25:29.836211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 15/27] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:28 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:30.642855 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-232194314", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1652406e-a728-4ceb-93be-3e053ed6049d"}], "security_groups": [{"name": "tempest-securitygroup--788029907"}], "key_name": "tempest-keypair-1930936376", "user_data": "}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:30.807757 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0be997c2-7692-454d-9080-1a324dd2614f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:30.810446 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0be997c2-7692-454d-9080-1a324dd2614f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:30.849405 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0be997c2-7692-454d-9080-1a324dd2614f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:30.850414 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0be997c2-7692-454d-9080-1a324dd2614f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:30.859677 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0be997c2-7692-454d-9080-1a324dd2614f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:30.860534 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0be997c2-7692-454d-9080-1a324dd2614f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:31.128463 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0be997c2-7692-454d-9080-1a324dd2614f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:31.140895 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0be997c2-7692-454d-9080-1a324dd2614f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1217 microversion: 2.1 time: 0.339148 May 13 13:25:31.144891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 16/28] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:30 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1217 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:31.170139 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f00d472b-43b8-400b-ba4e-6564772575ff tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:31.171116 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f00d472b-43b8-400b-ba4e-6564772575ff tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:31.187330 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f00d472b-43b8-400b-ba4e-6564772575ff tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:31.189954 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f00d472b-43b8-400b-ba4e-6564772575ff tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:31.191097 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f00d472b-43b8-400b-ba4e-6564772575ff tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:31.191785 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f00d472b-43b8-400b-ba4e-6564772575ff tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:31.367603 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] validate_networks() for [('1652406e-a728-4ceb-93be-3e053ed6049d', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:25:32.008763 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f00d472b-43b8-400b-ba4e-6564772575ff tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:32.019115 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f00d472b-43b8-400b-ba4e-6564772575ff tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.862599 May 13 13:25:32.035685 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 17/29] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:31 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:32.162782 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b9e569ea-c980-4969-b7e8-8fe8f5ef6769 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:32.163409 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b9e569ea-c980-4969-b7e8-8fe8f5ef6769 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:32.175465 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b9e569ea-c980-4969-b7e8-8fe8f5ef6769 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:32.179953 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b9e569ea-c980-4969-b7e8-8fe8f5ef6769 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:32.181991 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b9e569ea-c980-4969-b7e8-8fe8f5ef6769 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:32.186966 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b9e569ea-c980-4969-b7e8-8fe8f5ef6769 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:32.537293 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b9e569ea-c980-4969-b7e8-8fe8f5ef6769 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:32.547455 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b9e569ea-c980-4969-b7e8-8fe8f5ef6769 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1273 microversion: 2.1 time: 0.388821 May 13 13:25:32.550494 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 18/30] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:32 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1273 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:33.036679 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-bfb7b52f-988b-42d7-8978-727d8d6578e6 req-661c60b7-b070-4b6b-a511-8c787dd1579a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8fe7e67-a111-4f6b-9ddf-e13a0028db84", "tag": "a4f23c78-8204-4a15-829a-414f56fa3b61"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:33.072986 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-bfb7b52f-988b-42d7-8978-727d8d6578e6 req-661c60b7-b070-4b6b-a511-8c787dd1579a service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.084454 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-bfb7b52f-988b-42d7-8978-727d8d6578e6 req-661c60b7-b070-4b6b-a511-8c787dd1579a service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.144538 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-bfb7b52f-988b-42d7-8978-727d8d6578e6 req-661c60b7-b070-4b6b-a511-8c787dd1579a service nova] Creating event network-changed:a4f23c78-8204-4a15-829a-414f56fa3b61 for instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 on hv-cinder-84159 May 13 13:25:33.147358 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-bfb7b52f-988b-42d7-8978-727d8d6578e6 req-661c60b7-b070-4b6b-a511-8c787dd1579a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 13:25:33.147358 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2f0bc85-e8f4-4053-a8ca-f78e9ada5474 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.147358 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2f0bc85-e8f4-4053-a8ca-f78e9ada5474 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.170506 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2f0bc85-e8f4-4053-a8ca-f78e9ada5474 None None] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.171514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2f0bc85-e8f4-4053-a8ca-f78e9ada5474 None None] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.197242 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.compute.rpcapi [None req-c2f0bc85-e8f4-4053-a8ca-f78e9ada5474 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 13:25:33.200405 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2f0bc85-e8f4-4053-a8ca-f78e9ada5474 None None] Releasing lock "compute-rpcapi-router" {{(pid=117602) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 13:25:33.255251 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c2f0bc85-e8f4-4053-a8ca-f78e9ada5474 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.693074 May 13 13:25:33.256721 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 19/31] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:33.267538 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-25e97db1-15ed-4fe2-ad0e-ae23abc17fb1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:33.269400 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-25e97db1-15ed-4fe2-ad0e-ae23abc17fb1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:33.288513 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-25e97db1-15ed-4fe2-ad0e-ae23abc17fb1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.289356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-25e97db1-15ed-4fe2-ad0e-ae23abc17fb1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.291160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-25e97db1-15ed-4fe2-ad0e-ae23abc17fb1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.292086 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-25e97db1-15ed-4fe2-ad0e-ae23abc17fb1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.642176 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:25:33.653806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:25:33.653806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:25:33.653806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:25:33.653806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:25:33.689020 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.694003 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.702069 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:33.704167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:33.772166 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Getting quotas for project 4cd4aa315c4340a1a649d8c51cea0da9. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:25:33.777285 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Getting quotas for user 08b9fbf87cfa417fbea857ae602a140e and project 4cd4aa315c4340a1a649d8c51cea0da9. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:25:33.806990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:25:33.816326 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:25:34.124678 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7f591173-a0b9-4fc4-92df-7c006cef12ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.488569 May 13 13:25:34.126169 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 13/32] 10.222.0.25 () {62 vars in 1187 bytes} [Fri May 13 13:25:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 3491 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 13:25:34.162054 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e1e3cc56-872d-497e-9701-32c1d89b5a49 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:34.167861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e1e3cc56-872d-497e-9701-32c1d89b5a49 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:34.195479 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1e3cc56-872d-497e-9701-32c1d89b5a49 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:34.196872 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1e3cc56-872d-497e-9701-32c1d89b5a49 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:34.198418 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1e3cc56-872d-497e-9701-32c1d89b5a49 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:34.200165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1e3cc56-872d-497e-9701-32c1d89b5a49 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:34.809221 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-25e97db1-15ed-4fe2-ad0e-ae23abc17fb1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:34.817170 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-25e97db1-15ed-4fe2-ad0e-ae23abc17fb1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 1.557532 May 13 13:25:34.830236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 20/33] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:33 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:34.846660 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1115ce15-e754-49a2-b400-b8ee478dc03a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:34.847362 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1115ce15-e754-49a2-b400-b8ee478dc03a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:34.967018 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e1e3cc56-872d-497e-9701-32c1d89b5a49 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:34.974706 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e1e3cc56-872d-497e-9701-32c1d89b5a49 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1279 microversion: 2.1 time: 0.847317 May 13 13:25:34.975293 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 14/34] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:34 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1279 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:35.172538 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1115ce15-e754-49a2-b400-b8ee478dc03a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:35.185381 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1115ce15-e754-49a2-b400-b8ee478dc03a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:35.191210 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1115ce15-e754-49a2-b400-b8ee478dc03a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:35.207556 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1115ce15-e754-49a2-b400-b8ee478dc03a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1281 microversion: 2.20 time: 0.375507 May 13 13:25:35.209285 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 21/35] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:34 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1281 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:35.839015 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a3f22b14-2a6e-4299-9803-3647c960a998 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:35.839015 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a3f22b14-2a6e-4299-9803-3647c960a998 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:35.859058 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3f22b14-2a6e-4299-9803-3647c960a998 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:35.859705 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3f22b14-2a6e-4299-9803-3647c960a998 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:35.860642 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3f22b14-2a6e-4299-9803-3647c960a998 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:35.866360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3f22b14-2a6e-4299-9803-3647c960a998 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:35.994802 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-77766c8b-43ae-4a53-ba5d-d6a0dd54fb1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:35.995592 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-77766c8b-43ae-4a53-ba5d-d6a0dd54fb1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:36.032637 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-77766c8b-43ae-4a53-ba5d-d6a0dd54fb1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:36.039906 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-77766c8b-43ae-4a53-ba5d-d6a0dd54fb1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:36.041725 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-77766c8b-43ae-4a53-ba5d-d6a0dd54fb1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:36.042368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-77766c8b-43ae-4a53-ba5d-d6a0dd54fb1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:36.176440 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a3f22b14-2a6e-4299-9803-3647c960a998 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:36.186227 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a3f22b14-2a6e-4299-9803-3647c960a998 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.353726 May 13 13:25:36.203131 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 15/36] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:35 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:36.209252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1424394363", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dceba3d8-accd-41b8-a33c-38f5d7f6c90b"}], "security_groups": [{"name": "tempest-securitygroup--437928068"}], "key_name": "tempest-keypair-1155574201", "user_data": "}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:36.215081 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-77766c8b-43ae-4a53-ba5d-d6a0dd54fb1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:36.226452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-77766c8b-43ae-4a53-ba5d-d6a0dd54fb1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1279 microversion: 2.1 time: 0.237673 May 13 13:25:36.227043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 22/37] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:35 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:36.238581 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b83bb150-75db-4c5b-baa6-985de4b717d4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:36.241484 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b83bb150-75db-4c5b-baa6-985de4b717d4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:36.255538 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b83bb150-75db-4c5b-baa6-985de4b717d4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:36.256004 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b83bb150-75db-4c5b-baa6-985de4b717d4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:36.256810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b83bb150-75db-4c5b-baa6-985de4b717d4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:36.257252 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b83bb150-75db-4c5b-baa6-985de4b717d4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:36.473188 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] validate_networks() for [('dceba3d8-accd-41b8-a33c-38f5d7f6c90b', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:25:36.611866 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b83bb150-75db-4c5b-baa6-985de4b717d4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:36.637504 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b83bb150-75db-4c5b-baa6-985de4b717d4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:36.646247 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b83bb150-75db-4c5b-baa6-985de4b717d4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:36.651727 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b83bb150-75db-4c5b-baa6-985de4b717d4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1285 microversion: 2.20 time: 0.423677 May 13 13:25:36.664143 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 23/38] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:36 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1285 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:37.214308 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-aef6edd4-4f20-40b1-b62a-e2dcb1492e36 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:37.216202 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-aef6edd4-4f20-40b1-b62a-e2dcb1492e36 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:37.243957 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-aef6edd4-4f20-40b1-b62a-e2dcb1492e36 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.248553 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-aef6edd4-4f20-40b1-b62a-e2dcb1492e36 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:37.251829 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-aef6edd4-4f20-40b1-b62a-e2dcb1492e36 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.253415 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-aef6edd4-4f20-40b1-b62a-e2dcb1492e36 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:37.432931 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:25:37.438684 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:25:37.440986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:25:37.441815 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:25:37.447245 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:25:37.453080 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.453875 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:37.454944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.455567 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:37.486594 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Getting quotas for project 915a7ff1f6d64480a08c38e762da4134. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:25:37.509323 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Getting quotas for user 233f5342cf334c7689cb9e71f4fbaab3 and project 915a7ff1f6d64480a08c38e762da4134. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:25:37.544085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:25:37.546584 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:25:37.694120 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-aef6edd4-4f20-40b1-b62a-e2dcb1492e36 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:37.713443 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-aef6edd4-4f20-40b1-b62a-e2dcb1492e36 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.504784 May 13 13:25:37.714498 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 24/39] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:37 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:37.725311 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-32cfda95-52df-4a99-97c9-1a0edce481d6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:37.725972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-32cfda95-52df-4a99-97c9-1a0edce481d6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:37.747285 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-32cfda95-52df-4a99-97c9-1a0edce481d6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.747285 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-32cfda95-52df-4a99-97c9-1a0edce481d6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:37.747285 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-32cfda95-52df-4a99-97c9-1a0edce481d6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.747285 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-32cfda95-52df-4a99-97c9-1a0edce481d6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:37.759226 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b7d865c2-21b4-4165-baa3-edcc2fd37900 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.553887 May 13 13:25:37.780955 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 16/40] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:25:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:25:37.788554 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6b7882c5-a9c9-4f43-9eed-5504e4f0f81e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:37.799912 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6b7882c5-a9c9-4f43-9eed-5504e4f0f81e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:37.828711 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6b7882c5-a9c9-4f43-9eed-5504e4f0f81e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.829502 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6b7882c5-a9c9-4f43-9eed-5504e4f0f81e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:37.831464 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6b7882c5-a9c9-4f43-9eed-5504e4f0f81e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:37.834917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6b7882c5-a9c9-4f43-9eed-5504e4f0f81e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:38.019915 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6b7882c5-a9c9-4f43-9eed-5504e4f0f81e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:38.045935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6b7882c5-a9c9-4f43-9eed-5504e4f0f81e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:38.048086 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6b7882c5-a9c9-4f43-9eed-5504e4f0f81e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:38.053269 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6b7882c5-a9c9-4f43-9eed-5504e4f0f81e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1333 microversion: 2.20 time: 0.273602 May 13 13:25:38.055792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 17/41] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:37 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1333 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:38.069660 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cdb4ed9e-c698-4d15-a795-3791ffaeb5be tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:38.074014 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cdb4ed9e-c698-4d15-a795-3791ffaeb5be tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:38.173013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cdb4ed9e-c698-4d15-a795-3791ffaeb5be tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:38.190780 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cdb4ed9e-c698-4d15-a795-3791ffaeb5be tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1238 microversion: 2.1 time: 0.130754 May 13 13:25:38.190780 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 18/42] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:38 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1238 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:38.731445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-18fed16e-daf6-44cf-911e-05e43722a5c2 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:38.733100 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-18fed16e-daf6-44cf-911e-05e43722a5c2 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:38.756158 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18fed16e-daf6-44cf-911e-05e43722a5c2 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:38.760758 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18fed16e-daf6-44cf-911e-05e43722a5c2 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:38.763278 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18fed16e-daf6-44cf-911e-05e43722a5c2 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:38.766966 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-18fed16e-daf6-44cf-911e-05e43722a5c2 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:39.018483 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-18fed16e-daf6-44cf-911e-05e43722a5c2 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:39.018483 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-18fed16e-daf6-44cf-911e-05e43722a5c2 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.277548 May 13 13:25:39.018483 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 19/43] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:38 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:39.035984 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-32cfda95-52df-4a99-97c9-1a0edce481d6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:39.047094 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-32cfda95-52df-4a99-97c9-1a0edce481d6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1321 microversion: 2.1 time: 1.331559 May 13 13:25:39.047625 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 25/44] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:37 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1321 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:39.082393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-96a9a88b-bbf0-4163-ae14-710c371cbdb6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:39.137355 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-96a9a88b-bbf0-4163-ae14-710c371cbdb6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:39.137355 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-96a9a88b-bbf0-4163-ae14-710c371cbdb6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:39.137355 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-96a9a88b-bbf0-4163-ae14-710c371cbdb6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:39.137355 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-96a9a88b-bbf0-4163-ae14-710c371cbdb6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:39.138356 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-96a9a88b-bbf0-4163-ae14-710c371cbdb6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:39.183282 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-96a9a88b-bbf0-4163-ae14-710c371cbdb6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:39.196327 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-96a9a88b-bbf0-4163-ae14-710c371cbdb6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:39.209759 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-96a9a88b-bbf0-4163-ae14-710c371cbdb6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:39.209759 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-96a9a88b-bbf0-4163-ae14-710c371cbdb6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1339 microversion: 2.20 time: 0.129730 May 13 13:25:39.209759 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 20/45] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:39 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1339 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:39.210452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1f718440-e5ee-4658-9c25-e776e18af6c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:39.210452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1f718440-e5ee-4658-9c25-e776e18af6c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:39.390261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1f718440-e5ee-4658-9c25-e776e18af6c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:39.390261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1f718440-e5ee-4658-9c25-e776e18af6c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1238 microversion: 2.1 time: 0.141902 May 13 13:25:39.390261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 26/46] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:39 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1238 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:40.025372 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cead93ac-e189-4d27-8503-89e8ab51b905 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:40.026174 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cead93ac-e189-4d27-8503-89e8ab51b905 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:40.033705 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cead93ac-e189-4d27-8503-89e8ab51b905 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:40.036783 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cead93ac-e189-4d27-8503-89e8ab51b905 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.036783 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cead93ac-e189-4d27-8503-89e8ab51b905 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:40.036783 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cead93ac-e189-4d27-8503-89e8ab51b905 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.066416 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-53392a45-8000-4341-9b8e-3337132329bd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:40.066952 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-53392a45-8000-4341-9b8e-3337132329bd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:40.079635 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-53392a45-8000-4341-9b8e-3337132329bd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:40.087579 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-53392a45-8000-4341-9b8e-3337132329bd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.098537 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-53392a45-8000-4341-9b8e-3337132329bd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:40.098537 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-53392a45-8000-4341-9b8e-3337132329bd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.416463 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cead93ac-e189-4d27-8503-89e8ab51b905 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:40.442330 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cead93ac-e189-4d27-8503-89e8ab51b905 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.413512 May 13 13:25:40.450683 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 21/47] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:40 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:40.459486 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bdbb0bb6-3785-4b4c-a852-46bad6cc2789 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:40.460704 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bdbb0bb6-3785-4b4c-a852-46bad6cc2789 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:40.468563 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdbb0bb6-3785-4b4c-a852-46bad6cc2789 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:40.469228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdbb0bb6-3785-4b4c-a852-46bad6cc2789 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.470051 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdbb0bb6-3785-4b4c-a852-46bad6cc2789 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:40.470491 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdbb0bb6-3785-4b4c-a852-46bad6cc2789 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.513374 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-53392a45-8000-4341-9b8e-3337132329bd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:40.525720 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-53392a45-8000-4341-9b8e-3337132329bd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1321 microversion: 2.1 time: 0.461908 May 13 13:25:40.528270 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 27/48] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:40 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1321 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:40.542038 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-acda23a8-989b-42c4-b7b5-06dee6d0e3e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:40.542038 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-acda23a8-989b-42c4-b7b5-06dee6d0e3e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:40.575071 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-acda23a8-989b-42c4-b7b5-06dee6d0e3e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:40.575071 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-acda23a8-989b-42c4-b7b5-06dee6d0e3e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.575071 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-acda23a8-989b-42c4-b7b5-06dee6d0e3e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:40.575071 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-acda23a8-989b-42c4-b7b5-06dee6d0e3e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:40.681019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-acda23a8-989b-42c4-b7b5-06dee6d0e3e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:40.702853 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-acda23a8-989b-42c4-b7b5-06dee6d0e3e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1242 microversion: 2.1 time: 0.170311 May 13 13:25:40.705514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 28/49] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:40 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1242 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:40.953824 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bdbb0bb6-3785-4b4c-a852-46bad6cc2789 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:40.962213 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bdbb0bb6-3785-4b4c-a852-46bad6cc2789 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:40.965659 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bdbb0bb6-3785-4b4c-a852-46bad6cc2789 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:40.966938 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bdbb0bb6-3785-4b4c-a852-46bad6cc2789 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.514937 May 13 13:25:40.967991 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 22/50] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:40 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:41.251014 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-41e81b72-c943-4cc8-ab30-0cbe203a1232 req-531a067f-393a-47bc-b8dd-73bcf32a565d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "579ddd42-b56b-41a6-bf6b-601e7b699383", "tag": "56e2bb82-a229-4ab7-b089-0f87dc512a77"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:41.260445 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-41e81b72-c943-4cc8-ab30-0cbe203a1232 req-531a067f-393a-47bc-b8dd-73bcf32a565d service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:41.261118 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-41e81b72-c943-4cc8-ab30-0cbe203a1232 req-531a067f-393a-47bc-b8dd-73bcf32a565d service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:41.276276 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-41e81b72-c943-4cc8-ab30-0cbe203a1232 req-531a067f-393a-47bc-b8dd-73bcf32a565d service nova] Creating event network-changed:56e2bb82-a229-4ab7-b089-0f87dc512a77 for instance 579ddd42-b56b-41a6-bf6b-601e7b699383 on hv-cinder-84159 May 13 13:25:41.307699 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-41e81b72-c943-4cc8-ab30-0cbe203a1232 req-531a067f-393a-47bc-b8dd-73bcf32a565d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058887 May 13 13:25:41.316140 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 29/51] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:41.457641 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c03ed97c-1b89-474c-b807-dad0d24538d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:41.458617 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c03ed97c-1b89-474c-b807-dad0d24538d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:41.464583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c03ed97c-1b89-474c-b807-dad0d24538d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:41.465285 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c03ed97c-1b89-474c-b807-dad0d24538d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:41.466267 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c03ed97c-1b89-474c-b807-dad0d24538d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:41.466884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c03ed97c-1b89-474c-b807-dad0d24538d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:41.548801 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2271edd3-ab0d-4783-b219-99c2957cd274 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:41.549756 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2271edd3-ab0d-4783-b219-99c2957cd274 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:41.567894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2271edd3-ab0d-4783-b219-99c2957cd274 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:41.568719 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2271edd3-ab0d-4783-b219-99c2957cd274 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:41.571340 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2271edd3-ab0d-4783-b219-99c2957cd274 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:41.573528 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2271edd3-ab0d-4783-b219-99c2957cd274 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:42.143703 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c03ed97c-1b89-474c-b807-dad0d24538d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:42.151335 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c03ed97c-1b89-474c-b807-dad0d24538d1 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.697393 May 13 13:25:42.163067 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 23/52] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:41 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:42.171355 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6068c0d7-7591-42d0-87fd-91927815a2e8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:42.172074 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6068c0d7-7591-42d0-87fd-91927815a2e8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:42.184836 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6068c0d7-7591-42d0-87fd-91927815a2e8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:42.191902 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6068c0d7-7591-42d0-87fd-91927815a2e8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:42.195008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6068c0d7-7591-42d0-87fd-91927815a2e8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:42.198544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6068c0d7-7591-42d0-87fd-91927815a2e8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:42.370473 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6068c0d7-7591-42d0-87fd-91927815a2e8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:42.379392 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6068c0d7-7591-42d0-87fd-91927815a2e8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1290 microversion: 2.1 time: 0.214696 May 13 13:25:42.383709 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 24/53] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:42 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1290 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:42.385367 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2271edd3-ab0d-4783-b219-99c2957cd274 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:42.393372 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2271edd3-ab0d-4783-b219-99c2957cd274 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1321 microversion: 2.1 time: 0.852403 May 13 13:25:42.394418 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-27b35008-0109-48a0-a9f8-d1acd2ba1e0a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:42.396414 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-27b35008-0109-48a0-a9f8-d1acd2ba1e0a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:42.397312 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 30/54] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:41 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1321 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:42.407744 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-27b35008-0109-48a0-a9f8-d1acd2ba1e0a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:42.410068 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-27b35008-0109-48a0-a9f8-d1acd2ba1e0a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:42.411792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-27b35008-0109-48a0-a9f8-d1acd2ba1e0a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:42.413154 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-27b35008-0109-48a0-a9f8-d1acd2ba1e0a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:42.682542 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-27b35008-0109-48a0-a9f8-d1acd2ba1e0a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:42.696284 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-27b35008-0109-48a0-a9f8-d1acd2ba1e0a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:42.698550 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-27b35008-0109-48a0-a9f8-d1acd2ba1e0a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:42.700080 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-27b35008-0109-48a0-a9f8-d1acd2ba1e0a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.315137 May 13 13:25:42.700939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 25/55] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:42 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:43.174160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9809a2fd-daa3-4aa2-8e33-f318a355aa6d tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:43.175007 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-9809a2fd-daa3-4aa2-8e33-f318a355aa6d tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:43.182890 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9809a2fd-daa3-4aa2-8e33-f318a355aa6d tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:43.183704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9809a2fd-daa3-4aa2-8e33-f318a355aa6d tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:43.185203 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9809a2fd-daa3-4aa2-8e33-f318a355aa6d tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:43.185876 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9809a2fd-daa3-4aa2-8e33-f318a355aa6d tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:43.402998 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e3612827-4bb3-4a8d-bed3-578e188aeee4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:43.403806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e3612827-4bb3-4a8d-bed3-578e188aeee4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:43.421393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e3612827-4bb3-4a8d-bed3-578e188aeee4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:43.423086 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e3612827-4bb3-4a8d-bed3-578e188aeee4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:43.425808 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e3612827-4bb3-4a8d-bed3-578e188aeee4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:43.427736 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e3612827-4bb3-4a8d-bed3-578e188aeee4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:43.637405 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e3612827-4bb3-4a8d-bed3-578e188aeee4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:43.647372 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e3612827-4bb3-4a8d-bed3-578e188aeee4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1308 microversion: 2.1 time: 0.249924 May 13 13:25:43.648166 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 26/56] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:43 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:43.664762 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-80ca2f2a-fba0-4ddb-be48-250c251066b8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:43.665395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-80ca2f2a-fba0-4ddb-be48-250c251066b8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:43.693812 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-80ca2f2a-fba0-4ddb-be48-250c251066b8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:43.694440 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-80ca2f2a-fba0-4ddb-be48-250c251066b8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:43.699935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-80ca2f2a-fba0-4ddb-be48-250c251066b8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:43.700584 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-80ca2f2a-fba0-4ddb-be48-250c251066b8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.052021 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-80ca2f2a-fba0-4ddb-be48-250c251066b8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:44.077001 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-80ca2f2a-fba0-4ddb-be48-250c251066b8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1321 microversion: 2.1 time: 0.427576 May 13 13:25:44.077608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 27/57] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:43 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:44.106476 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-9809a2fd-daa3-4aa2-8e33-f318a355aa6d tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:44.114005 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-9809a2fd-daa3-4aa2-8e33-f318a355aa6d tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.947023 May 13 13:25:44.116018 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 31/58] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:43 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:44.122558 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-03d0aa1c-cc9f-4e7a-9f84-30c110ea482d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:44.126067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-03d0aa1c-cc9f-4e7a-9f84-30c110ea482d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:44.136533 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03d0aa1c-cc9f-4e7a-9f84-30c110ea482d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:44.137088 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03d0aa1c-cc9f-4e7a-9f84-30c110ea482d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.137916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03d0aa1c-cc9f-4e7a-9f84-30c110ea482d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:44.138363 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03d0aa1c-cc9f-4e7a-9f84-30c110ea482d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.296186 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-a22023d5-8636-41af-b4e3-30f5a6790f04 req-4621fa80-5f7d-4d73-94e0-27ef091097d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89412841-b653-4a80-8cde-0c7a264a9c4c", "tag": "1a4cef43-4ad0-41f0-9857-11ea57340642"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:44.317430 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-a22023d5-8636-41af-b4e3-30f5a6790f04 req-4621fa80-5f7d-4d73-94e0-27ef091097d5 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:44.318728 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-a22023d5-8636-41af-b4e3-30f5a6790f04 req-4621fa80-5f7d-4d73-94e0-27ef091097d5 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.375213 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-a22023d5-8636-41af-b4e3-30f5a6790f04 req-4621fa80-5f7d-4d73-94e0-27ef091097d5 service nova] Creating event network-changed:1a4cef43-4ad0-41f0-9857-11ea57340642 for instance 89412841-b653-4a80-8cde-0c7a264a9c4c on hv-cinder-84159 May 13 13:25:44.378401 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-a22023d5-8636-41af-b4e3-30f5a6790f04 req-4621fa80-5f7d-4d73-94e0-27ef091097d5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 13:25:44.378401 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-314ea08e-de34-4e19-b3d1-5a444e56d426 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:44.378401 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-314ea08e-de34-4e19-b3d1-5a444e56d426 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.379684 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-314ea08e-de34-4e19-b3d1-5a444e56d426 None None] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:44.380588 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-314ea08e-de34-4e19-b3d1-5a444e56d426 None None] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.392369 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.compute.rpcapi [None req-314ea08e-de34-4e19-b3d1-5a444e56d426 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 13:25:44.393516 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-314ea08e-de34-4e19-b3d1-5a444e56d426 None None] Releasing lock "compute-rpcapi-router" {{(pid=117603) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 13:25:44.438434 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-314ea08e-de34-4e19-b3d1-5a444e56d426 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.336105 May 13 13:25:44.439210 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 28/59] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:44.474031 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-03d0aa1c-cc9f-4e7a-9f84-30c110ea482d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:44.484693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-03d0aa1c-cc9f-4e7a-9f84-30c110ea482d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:44.486452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-03d0aa1c-cc9f-4e7a-9f84-30c110ea482d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:44.487904 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-03d0aa1c-cc9f-4e7a-9f84-30c110ea482d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.370687 May 13 13:25:44.488631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 32/60] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:44 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:44.669900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9e2c5fe9-b7e3-4c59-a091-27820460224c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:44.670634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9e2c5fe9-b7e3-4c59-a091-27820460224c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:44.677454 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e2c5fe9-b7e3-4c59-a091-27820460224c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:44.677952 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e2c5fe9-b7e3-4c59-a091-27820460224c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.678730 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e2c5fe9-b7e3-4c59-a091-27820460224c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:44.679169 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e2c5fe9-b7e3-4c59-a091-27820460224c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:44.748669 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9e2c5fe9-b7e3-4c59-a091-27820460224c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:44.756834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9e2c5fe9-b7e3-4c59-a091-27820460224c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1296 microversion: 2.1 time: 0.091875 May 13 13:25:44.757474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 29/61] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:44 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:45.094611 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d09982c9-c7dc-4490-ae2a-157ad288deb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:45.095182 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d09982c9-c7dc-4490-ae2a-157ad288deb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:45.101043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d09982c9-c7dc-4490-ae2a-157ad288deb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.101497 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d09982c9-c7dc-4490-ae2a-157ad288deb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.102296 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d09982c9-c7dc-4490-ae2a-157ad288deb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.102738 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d09982c9-c7dc-4490-ae2a-157ad288deb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.136098 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-105725f5-63fd-42ac-aaf7-535d63d8aadf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:45.137292 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-105725f5-63fd-42ac-aaf7-535d63d8aadf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:45.143255 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-105725f5-63fd-42ac-aaf7-535d63d8aadf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.174105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-105725f5-63fd-42ac-aaf7-535d63d8aadf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.174105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-105725f5-63fd-42ac-aaf7-535d63d8aadf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.174105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-105725f5-63fd-42ac-aaf7-535d63d8aadf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.396845 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d09982c9-c7dc-4490-ae2a-157ad288deb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:45.409842 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d09982c9-c7dc-4490-ae2a-157ad288deb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1321 microversion: 2.1 time: 0.316159 May 13 13:25:45.410496 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 33/62] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:45 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:45.418176 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-900d61e3-6148-489d-a5d7-6be40e13305c req-36ce5f55-2dc4-43f7-9f91-9f45ee162fcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f73c3e-c6fc-443b-a892-bf21c184de0c", "tag": "7cb95faf-543f-4107-b4e6-b572ee1da4e2"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:45.560171 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-105725f5-63fd-42ac-aaf7-535d63d8aadf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:45.561579 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-900d61e3-6148-489d-a5d7-6be40e13305c req-36ce5f55-2dc4-43f7-9f91-9f45ee162fcc service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.561579 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-900d61e3-6148-489d-a5d7-6be40e13305c req-36ce5f55-2dc4-43f7-9f91-9f45ee162fcc service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.562154 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-105725f5-63fd-42ac-aaf7-535d63d8aadf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.352883 May 13 13:25:45.562154 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 30/63] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:45 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:45.562317 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-900d61e3-6148-489d-a5d7-6be40e13305c req-36ce5f55-2dc4-43f7-9f91-9f45ee162fcc service nova] Creating event network-changed:7cb95faf-543f-4107-b4e6-b572ee1da4e2 for instance a1f73c3e-c6fc-443b-a892-bf21c184de0c on hv-cinder-84159 May 13 13:25:45.562397 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-af1d12c7-7e2c-412f-a88d-7801bd42803b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:45.562397 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-af1d12c7-7e2c-412f-a88d-7801bd42803b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:45.562559 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-900d61e3-6148-489d-a5d7-6be40e13305c req-36ce5f55-2dc4-43f7-9f91-9f45ee162fcc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099865 May 13 13:25:45.562559 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 34/64] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:45.562708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-af1d12c7-7e2c-412f-a88d-7801bd42803b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.562708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-af1d12c7-7e2c-412f-a88d-7801bd42803b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.562708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-af1d12c7-7e2c-412f-a88d-7801bd42803b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.562708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-af1d12c7-7e2c-412f-a88d-7801bd42803b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.710596 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-af1d12c7-7e2c-412f-a88d-7801bd42803b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:45.719533 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-af1d12c7-7e2c-412f-a88d-7801bd42803b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:45.721083 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-af1d12c7-7e2c-412f-a88d-7801bd42803b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:45.722277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-af1d12c7-7e2c-412f-a88d-7801bd42803b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.219501 May 13 13:25:45.725840 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 31/65] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:45 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:45.774835 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3f14d549-c24d-4d94-899e-52731e424e55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:45.775630 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3f14d549-c24d-4d94-899e-52731e424e55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:45.782291 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3f14d549-c24d-4d94-899e-52731e424e55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.782817 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3f14d549-c24d-4d94-899e-52731e424e55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.783605 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3f14d549-c24d-4d94-899e-52731e424e55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:45.784038 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3f14d549-c24d-4d94-899e-52731e424e55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:45.877325 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3f14d549-c24d-4d94-899e-52731e424e55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:45.885227 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3f14d549-c24d-4d94-899e-52731e424e55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1296 microversion: 2.1 time: 0.114438 May 13 13:25:45.886904 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 35/66] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:45 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1296 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:46.428118 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d19efffd-48da-4bb4-8a70-c364d0296dc2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:46.430435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d19efffd-48da-4bb4-8a70-c364d0296dc2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:46.438519 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d19efffd-48da-4bb4-8a70-c364d0296dc2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:46.438976 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d19efffd-48da-4bb4-8a70-c364d0296dc2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:46.439769 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d19efffd-48da-4bb4-8a70-c364d0296dc2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:46.440354 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d19efffd-48da-4bb4-8a70-c364d0296dc2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:46.579148 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-050e21f0-ef39-4655-b0a7-e127ff185f37 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:46.579835 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-050e21f0-ef39-4655-b0a7-e127ff185f37 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:46.592196 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-050e21f0-ef39-4655-b0a7-e127ff185f37 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:46.593275 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-050e21f0-ef39-4655-b0a7-e127ff185f37 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:46.594411 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-050e21f0-ef39-4655-b0a7-e127ff185f37 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:46.594411 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-050e21f0-ef39-4655-b0a7-e127ff185f37 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:46.761272 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d19efffd-48da-4bb4-8a70-c364d0296dc2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:46.770966 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d19efffd-48da-4bb4-8a70-c364d0296dc2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1321 microversion: 2.1 time: 0.347343 May 13 13:25:46.771882 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 32/67] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:46 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:46.785909 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c71f24c7-29ea-486d-a771-3f2467cae2d3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:46.786792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c71f24c7-29ea-486d-a771-3f2467cae2d3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:46.799063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c71f24c7-29ea-486d-a771-3f2467cae2d3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:46.802858 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c71f24c7-29ea-486d-a771-3f2467cae2d3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:46.803935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c71f24c7-29ea-486d-a771-3f2467cae2d3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:46.804563 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c71f24c7-29ea-486d-a771-3f2467cae2d3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.165806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c71f24c7-29ea-486d-a771-3f2467cae2d3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:47.171219 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-050e21f0-ef39-4655-b0a7-e127ff185f37 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:47.181859 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-050e21f0-ef39-4655-b0a7-e127ff185f37 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.608258 May 13 13:25:47.182048 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c71f24c7-29ea-486d-a771-3f2467cae2d3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:47.185458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 36/68] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:46 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:47.185648 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c71f24c7-29ea-486d-a771-3f2467cae2d3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:47.186841 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c71f24c7-29ea-486d-a771-3f2467cae2d3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.406687 May 13 13:25:47.192685 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 33/69] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:46 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:47.209053 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9d8e2dc9-37f8-4ed3-8890-b358fadf8190 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:47.209980 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9d8e2dc9-37f8-4ed3-8890-b358fadf8190 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:47.227701 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d8e2dc9-37f8-4ed3-8890-b358fadf8190 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.229301 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d8e2dc9-37f8-4ed3-8890-b358fadf8190 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.232474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d8e2dc9-37f8-4ed3-8890-b358fadf8190 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.234670 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d8e2dc9-37f8-4ed3-8890-b358fadf8190 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.498188 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-57e7eabb-42bf-4075-8b33-d11d49cc00f6 req-6efcd607-def2-477f-b5dd-61124d2988ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fe7e67-a111-4f6b-9ddf-e13a0028db84", "name": "network-vif-plugged", "status": "completed", "tag": "a4f23c78-8204-4a15-829a-414f56fa3b61"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:47.517828 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-57e7eabb-42bf-4075-8b33-d11d49cc00f6 req-6efcd607-def2-477f-b5dd-61124d2988ea service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.518063 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-57e7eabb-42bf-4075-8b33-d11d49cc00f6 req-6efcd607-def2-477f-b5dd-61124d2988ea service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.539639 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9d8e2dc9-37f8-4ed3-8890-b358fadf8190 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:47.547696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9d8e2dc9-37f8-4ed3-8890-b358fadf8190 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.350451 May 13 13:25:47.548503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 34/70] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:47 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:47.562312 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-57e7eabb-42bf-4075-8b33-d11d49cc00f6 req-6efcd607-def2-477f-b5dd-61124d2988ea service nova] Creating event network-vif-plugged:a4f23c78-8204-4a15-829a-414f56fa3b61 for instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 on hv-cinder-84159 May 13 13:25:47.569027 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-57e7eabb-42bf-4075-8b33-d11d49cc00f6 req-6efcd607-def2-477f-b5dd-61124d2988ea service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.377819 May 13 13:25:47.569920 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 37/71] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:47.788714 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5643811c-5453-4bcc-8beb-4e098427d205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:47.789334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5643811c-5453-4bcc-8beb-4e098427d205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:47.800030 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5643811c-5453-4bcc-8beb-4e098427d205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.800629 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5643811c-5453-4bcc-8beb-4e098427d205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.801414 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5643811c-5453-4bcc-8beb-4e098427d205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:47.801867 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5643811c-5453-4bcc-8beb-4e098427d205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:47.945571 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5643811c-5453-4bcc-8beb-4e098427d205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:47.953903 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5643811c-5453-4bcc-8beb-4e098427d205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1321 microversion: 2.1 time: 0.168997 May 13 13:25:47.954711 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 35/72] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:47 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:48.204098 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-bd9501f0-bc24-44ca-bdb7-070b64e7b705 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:48.205834 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-bd9501f0-bc24-44ca-bdb7-070b64e7b705 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:48.214703 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bd9501f0-bc24-44ca-bdb7-070b64e7b705 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.215428 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bd9501f0-bc24-44ca-bdb7-070b64e7b705 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.218723 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bd9501f0-bc24-44ca-bdb7-070b64e7b705 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.218723 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bd9501f0-bc24-44ca-bdb7-070b64e7b705 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.222132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-978f78d9-6816-44a8-8b49-286929fbf82a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:48.223296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-978f78d9-6816-44a8-8b49-286929fbf82a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:48.244410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-978f78d9-6816-44a8-8b49-286929fbf82a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.244880 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-978f78d9-6816-44a8-8b49-286929fbf82a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.245691 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-978f78d9-6816-44a8-8b49-286929fbf82a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.246746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-978f78d9-6816-44a8-8b49-286929fbf82a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.567010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-978f78d9-6816-44a8-8b49-286929fbf82a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:48.578520 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-978f78d9-6816-44a8-8b49-286929fbf82a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:48.590299 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-978f78d9-6816-44a8-8b49-286929fbf82a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:48.591470 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-978f78d9-6816-44a8-8b49-286929fbf82a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.383060 May 13 13:25:48.597221 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 36/73] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:48 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:48.599432 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ff9b3e6f-347a-460d-ab72-b9256dba6404 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:48.600074 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ff9b3e6f-347a-460d-ab72-b9256dba6404 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:48.610329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff9b3e6f-347a-460d-ab72-b9256dba6404 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.610803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff9b3e6f-347a-460d-ab72-b9256dba6404 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.612239 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff9b3e6f-347a-460d-ab72-b9256dba6404 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.612912 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ff9b3e6f-347a-460d-ab72-b9256dba6404 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.622090 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bd9501f0-bc24-44ca-bdb7-070b64e7b705 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:48.633946 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-bd9501f0-bc24-44ca-bdb7-070b64e7b705 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.433340 May 13 13:25:48.655349 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 38/74] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:48 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:48.773245 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-91aa19d2-8219-49e4-b74e-fab7007a13cc req-740bf94d-a785-4096-8814-a027abb1b8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f", "tag": "14a7371d-78d5-4d51-b08a-8cd6ecaa1263"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:48.784897 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ff9b3e6f-347a-460d-ab72-b9256dba6404 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:48.791057 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-91aa19d2-8219-49e4-b74e-fab7007a13cc req-740bf94d-a785-4096-8814-a027abb1b8f6 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.794347 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ff9b3e6f-347a-460d-ab72-b9256dba6404 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.201282 May 13 13:25:48.796720 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 37/75] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:48 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:48.798187 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-91aa19d2-8219-49e4-b74e-fab7007a13cc req-740bf94d-a785-4096-8814-a027abb1b8f6 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.822040 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-91aa19d2-8219-49e4-b74e-fab7007a13cc req-740bf94d-a785-4096-8814-a027abb1b8f6 service nova] Creating event network-changed:14a7371d-78d5-4d51-b08a-8cd6ecaa1263 for instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f on hv-cinder-84159 May 13 13:25:48.830915 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-91aa19d2-8219-49e4-b74e-fab7007a13cc req-740bf94d-a785-4096-8814-a027abb1b8f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064627 May 13 13:25:48.834418 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 39/76] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:25:48.971992 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b9e2dc32-c982-4cb8-a19a-61abfbef885e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:48.972898 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b9e2dc32-c982-4cb8-a19a-61abfbef885e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:48.986384 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9e2dc32-c982-4cb8-a19a-61abfbef885e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.986384 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9e2dc32-c982-4cb8-a19a-61abfbef885e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:48.986384 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9e2dc32-c982-4cb8-a19a-61abfbef885e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:48.986384 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9e2dc32-c982-4cb8-a19a-61abfbef885e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.113430 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b9e2dc32-c982-4cb8-a19a-61abfbef885e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:49.120801 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b9e2dc32-c982-4cb8-a19a-61abfbef885e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1321 microversion: 2.1 time: 0.153117 May 13 13:25:49.121516 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 38/77] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:48 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:49.609492 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-bd468a9a-b39f-4bed-b373-70d2469c7ff7 req-bbdefc14-579b-4d3f-b151-533fa3a984bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579ddd42-b56b-41a6-bf6b-601e7b699383", "name": "network-vif-plugged", "status": "completed", "tag": "56e2bb82-a229-4ab7-b089-0f87dc512a77"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:49.620206 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2985bef0-c5e3-4ac5-ac70-c8428a093438 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:49.622041 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2985bef0-c5e3-4ac5-ac70-c8428a093438 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:49.631840 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2985bef0-c5e3-4ac5-ac70-c8428a093438 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.634335 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2985bef0-c5e3-4ac5-ac70-c8428a093438 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.636394 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2985bef0-c5e3-4ac5-ac70-c8428a093438 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.637211 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2985bef0-c5e3-4ac5-ac70-c8428a093438 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.637487 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-bd468a9a-b39f-4bed-b373-70d2469c7ff7 req-bbdefc14-579b-4d3f-b151-533fa3a984bf service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.639142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-bd468a9a-b39f-4bed-b373-70d2469c7ff7 req-bbdefc14-579b-4d3f-b151-533fa3a984bf service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.662482 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-bd468a9a-b39f-4bed-b373-70d2469c7ff7 req-bbdefc14-579b-4d3f-b151-533fa3a984bf service nova] Creating event network-vif-plugged:56e2bb82-a229-4ab7-b089-0f87dc512a77 for instance 579ddd42-b56b-41a6-bf6b-601e7b699383 on hv-cinder-84159 May 13 13:25:49.676728 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-bd468a9a-b39f-4bed-b373-70d2469c7ff7 req-bbdefc14-579b-4d3f-b151-533fa3a984bf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073395 May 13 13:25:49.678735 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 40/78] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:49.688386 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-fc62dc37-182f-41fe-8c5c-29067ecc889e tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:49.691357 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-fc62dc37-182f-41fe-8c5c-29067ecc889e tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:49.697259 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fc62dc37-182f-41fe-8c5c-29067ecc889e tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.697956 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fc62dc37-182f-41fe-8c5c-29067ecc889e tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.699073 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fc62dc37-182f-41fe-8c5c-29067ecc889e tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.699721 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fc62dc37-182f-41fe-8c5c-29067ecc889e tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.884310 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2985bef0-c5e3-4ac5-ac70-c8428a093438 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:49.893735 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2985bef0-c5e3-4ac5-ac70-c8428a093438 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:49.895486 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2985bef0-c5e3-4ac5-ac70-c8428a093438 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:49.896726 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2985bef0-c5e3-4ac5-ac70-c8428a093438 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.280668 May 13 13:25:49.897298 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 39/79] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:49 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:49.918424 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fad11224-962b-4de8-b6d3-df1f76c80715 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:49.919072 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fad11224-962b-4de8-b6d3-df1f76c80715 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:49.928303 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fad11224-962b-4de8-b6d3-df1f76c80715 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.928766 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fad11224-962b-4de8-b6d3-df1f76c80715 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:49.929552 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fad11224-962b-4de8-b6d3-df1f76c80715 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:49.930028 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fad11224-962b-4de8-b6d3-df1f76c80715 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:50.036638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-fc62dc37-182f-41fe-8c5c-29067ecc889e tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:50.050882 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-fc62dc37-182f-41fe-8c5c-29067ecc889e tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1315 microversion: 2.1 time: 0.370403 May 13 13:25:50.051702 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 41/80] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:49 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:50.141580 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-bea6d6e7-ae0a-4b14-b0aa-2975cd55bdac tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:50.144302 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-bea6d6e7-ae0a-4b14-b0aa-2975cd55bdac tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:50.155026 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bea6d6e7-ae0a-4b14-b0aa-2975cd55bdac tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:50.156628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bea6d6e7-ae0a-4b14-b0aa-2975cd55bdac tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:50.159191 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bea6d6e7-ae0a-4b14-b0aa-2975cd55bdac tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:50.159981 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bea6d6e7-ae0a-4b14-b0aa-2975cd55bdac tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:50.193100 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fad11224-962b-4de8-b6d3-df1f76c80715 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:50.204146 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fad11224-962b-4de8-b6d3-df1f76c80715 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.304357 May 13 13:25:50.205629 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 40/81] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:49 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:50.460912 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bea6d6e7-ae0a-4b14-b0aa-2975cd55bdac tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:50.488817 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-bea6d6e7-ae0a-4b14-b0aa-2975cd55bdac tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1321 microversion: 2.1 time: 0.354516 May 13 13:25:50.505752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 42/82] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:50 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:50.934599 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-37a3c294-e112-4f7f-9bd7-b342f0baaeaa tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:50.940052 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-37a3c294-e112-4f7f-9bd7-b342f0baaeaa tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:50.951341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37a3c294-e112-4f7f-9bd7-b342f0baaeaa tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:50.953377 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37a3c294-e112-4f7f-9bd7-b342f0baaeaa tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:50.956962 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37a3c294-e112-4f7f-9bd7-b342f0baaeaa tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:50.958259 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37a3c294-e112-4f7f-9bd7-b342f0baaeaa tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.076604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-989badbd-cfa8-44f6-b4cb-661cd52a6c8c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:51.077284 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-989badbd-cfa8-44f6-b4cb-661cd52a6c8c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:51.089109 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-989badbd-cfa8-44f6-b4cb-661cd52a6c8c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.090373 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-989badbd-cfa8-44f6-b4cb-661cd52a6c8c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.108681 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-989badbd-cfa8-44f6-b4cb-661cd52a6c8c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.109278 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-989badbd-cfa8-44f6-b4cb-661cd52a6c8c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.128244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-37a3c294-e112-4f7f-9bd7-b342f0baaeaa tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:51.140662 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-37a3c294-e112-4f7f-9bd7-b342f0baaeaa tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:51.143064 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-37a3c294-e112-4f7f-9bd7-b342f0baaeaa tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:51.144916 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-37a3c294-e112-4f7f-9bd7-b342f0baaeaa tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.228923 May 13 13:25:51.156818 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 41/83] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:50 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:51.223705 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-673a4018-94f9-448a-bc66-88a159ffa9d9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:51.224618 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-673a4018-94f9-448a-bc66-88a159ffa9d9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:51.232599 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-673a4018-94f9-448a-bc66-88a159ffa9d9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.233284 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-673a4018-94f9-448a-bc66-88a159ffa9d9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.234366 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-673a4018-94f9-448a-bc66-88a159ffa9d9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.234960 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-673a4018-94f9-448a-bc66-88a159ffa9d9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.352110 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-989badbd-cfa8-44f6-b4cb-661cd52a6c8c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:51.372852 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-989badbd-cfa8-44f6-b4cb-661cd52a6c8c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1501 microversion: 2.1 time: 0.300979 May 13 13:25:51.373448 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 43/84] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:51 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1501 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:51.462634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-673a4018-94f9-448a-bc66-88a159ffa9d9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:51.482897 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-673a4018-94f9-448a-bc66-88a159ffa9d9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.256506 May 13 13:25:51.482897 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 42/85] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:51 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:51.517700 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6c250aec-ed6a-4302-b495-b3e353533aa3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:51.518361 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6c250aec-ed6a-4302-b495-b3e353533aa3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:51.528370 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6c250aec-ed6a-4302-b495-b3e353533aa3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.529256 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6c250aec-ed6a-4302-b495-b3e353533aa3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.530438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6c250aec-ed6a-4302-b495-b3e353533aa3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.530880 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6c250aec-ed6a-4302-b495-b3e353533aa3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.696237 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6c250aec-ed6a-4302-b495-b3e353533aa3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:51.704744 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6c250aec-ed6a-4302-b495-b3e353533aa3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1321 microversion: 2.1 time: 0.191445 May 13 13:25:51.705560 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 44/86] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:51 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:51.735311 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-e1a35081-8849-4d8b-9fe2-6803448fc280 req-6d49e2e4-4547-4a39-af14-78eb9b4ce05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89412841-b653-4a80-8cde-0c7a264a9c4c", "name": "network-vif-plugged", "status": "completed", "tag": "1a4cef43-4ad0-41f0-9857-11ea57340642"}, {"server_uuid": "a1f73c3e-c6fc-443b-a892-bf21c184de0c", "name": "network-vif-plugged", "status": "completed", "tag": "7cb95faf-543f-4107-b4e6-b572ee1da4e2"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:51.746250 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-e1a35081-8849-4d8b-9fe2-6803448fc280 req-6d49e2e4-4547-4a39-af14-78eb9b4ce05d service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:51.746946 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-e1a35081-8849-4d8b-9fe2-6803448fc280 req-6d49e2e4-4547-4a39-af14-78eb9b4ce05d service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:51.759617 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-e1a35081-8849-4d8b-9fe2-6803448fc280 req-6d49e2e4-4547-4a39-af14-78eb9b4ce05d service nova] Creating event network-vif-plugged:1a4cef43-4ad0-41f0-9857-11ea57340642 for instance 89412841-b653-4a80-8cde-0c7a264a9c4c on hv-cinder-84159 May 13 13:25:51.760201 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-e1a35081-8849-4d8b-9fe2-6803448fc280 req-6d49e2e4-4547-4a39-af14-78eb9b4ce05d service nova] Creating event network-vif-plugged:7cb95faf-543f-4107-b4e6-b572ee1da4e2 for instance a1f73c3e-c6fc-443b-a892-bf21c184de0c on hv-cinder-84159 May 13 13:25:51.768545 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-e1a35081-8849-4d8b-9fe2-6803448fc280 req-6d49e2e4-4547-4a39-af14-78eb9b4ce05d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037290 May 13 13:25:51.769254 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 43/87] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:25:52.163601 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-93cb69d0-9504-4de2-bee8-6d6c58e44f8c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:52.164208 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-93cb69d0-9504-4de2-bee8-6d6c58e44f8c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:52.170729 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-93cb69d0-9504-4de2-bee8-6d6c58e44f8c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.171182 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-93cb69d0-9504-4de2-bee8-6d6c58e44f8c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.171938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-93cb69d0-9504-4de2-bee8-6d6c58e44f8c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.172373 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-93cb69d0-9504-4de2-bee8-6d6c58e44f8c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.333116 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-93cb69d0-9504-4de2-bee8-6d6c58e44f8c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:52.343280 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-93cb69d0-9504-4de2-bee8-6d6c58e44f8c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:52.344795 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-93cb69d0-9504-4de2-bee8-6d6c58e44f8c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:52.347253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-93cb69d0-9504-4de2-bee8-6d6c58e44f8c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.187696 May 13 13:25:52.348133 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 45/88] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:52 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:52.498337 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-67d7c27d-c3b8-46c3-bddd-d3b8b6a82b0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:52.504489 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-67d7c27d-c3b8-46c3-bddd-d3b8b6a82b0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:52.507378 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-67d7c27d-c3b8-46c3-bddd-d3b8b6a82b0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.507915 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-67d7c27d-c3b8-46c3-bddd-d3b8b6a82b0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.508765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-67d7c27d-c3b8-46c3-bddd-d3b8b6a82b0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.509276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-67d7c27d-c3b8-46c3-bddd-d3b8b6a82b0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.664980 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-67d7c27d-c3b8-46c3-bddd-d3b8b6a82b0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:52.672508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-67d7c27d-c3b8-46c3-bddd-d3b8b6a82b0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.179172 May 13 13:25:52.674656 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 44/89] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:52 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:52.723728 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-79777fa1-7dbf-424f-92b7-eecb79ee40c5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:52.724506 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-79777fa1-7dbf-424f-92b7-eecb79ee40c5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:52.731011 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-79777fa1-7dbf-424f-92b7-eecb79ee40c5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.731471 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-79777fa1-7dbf-424f-92b7-eecb79ee40c5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.735120 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-79777fa1-7dbf-424f-92b7-eecb79ee40c5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:52.735120 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-79777fa1-7dbf-424f-92b7-eecb79ee40c5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:52.903181 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-79777fa1-7dbf-424f-92b7-eecb79ee40c5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:52.910317 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-79777fa1-7dbf-424f-92b7-eecb79ee40c5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1321 microversion: 2.1 time: 0.192311 May 13 13:25:52.910870 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 46/90] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:52 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:53.367914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7f578e6a-e92c-4689-bc6a-803f3c1416e4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:53.368605 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7f578e6a-e92c-4689-bc6a-803f3c1416e4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:53.381109 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7f578e6a-e92c-4689-bc6a-803f3c1416e4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.381696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7f578e6a-e92c-4689-bc6a-803f3c1416e4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:53.382596 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7f578e6a-e92c-4689-bc6a-803f3c1416e4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.384630 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7f578e6a-e92c-4689-bc6a-803f3c1416e4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:53.448310 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9a44bc54-7f67-44d0-9769-2653ee8b90cd tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "735f127e-0175-44b3-9d7a-6764d3153ffc"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:53.451563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-9a44bc54-7f67-44d0-9769-2653ee8b90cd tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:53.459239 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9a44bc54-7f67-44d0-9769-2653ee8b90cd tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.460619 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9a44bc54-7f67-44d0-9769-2653ee8b90cd tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:53.461779 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9a44bc54-7f67-44d0-9769-2653ee8b90cd tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.462488 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9a44bc54-7f67-44d0-9769-2653ee8b90cd tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:53.579010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7f578e6a-e92c-4689-bc6a-803f3c1416e4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:53.587604 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7f578e6a-e92c-4689-bc6a-803f3c1416e4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:53.589990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7f578e6a-e92c-4689-bc6a-803f3c1416e4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:53.591150 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7f578e6a-e92c-4689-bc6a-803f3c1416e4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.228887 May 13 13:25:53.595237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 45/91] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:53 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:53.691902 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5de80c60-316c-4495-9195-e6291efcedea tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:53.692512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5de80c60-316c-4495-9195-e6291efcedea tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:53.699058 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5de80c60-316c-4495-9195-e6291efcedea tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.704328 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5de80c60-316c-4495-9195-e6291efcedea tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:53.704328 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5de80c60-316c-4495-9195-e6291efcedea tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.704328 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5de80c60-316c-4495-9195-e6291efcedea tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:53.843423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5de80c60-316c-4495-9195-e6291efcedea tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:53.851410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5de80c60-316c-4495-9195-e6291efcedea tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.163285 May 13 13:25:53.854246 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 46/92] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:53 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:53.927316 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cd148693-34a3-4114-aff6-c1e56d23989a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:53.927931 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cd148693-34a3-4114-aff6-c1e56d23989a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:53.933752 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd148693-34a3-4114-aff6-c1e56d23989a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.934234 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd148693-34a3-4114-aff6-c1e56d23989a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:53.934990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd148693-34a3-4114-aff6-c1e56d23989a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:53.935421 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd148693-34a3-4114-aff6-c1e56d23989a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.080195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cd148693-34a3-4114-aff6-c1e56d23989a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:54.087446 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cd148693-34a3-4114-aff6-c1e56d23989a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1514 microversion: 2.1 time: 0.163853 May 13 13:25:54.088012 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 47/93] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:53 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:54.105215 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-49b094d8-e613-43f2-ad3e-47e5d882b411 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:25:54.106251 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-49b094d8-e613-43f2-ad3e-47e5d882b411 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:54.112145 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49b094d8-e613-43f2-ad3e-47e5d882b411 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.112596 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49b094d8-e613-43f2-ad3e-47e5d882b411 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.113356 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49b094d8-e613-43f2-ad3e-47e5d882b411 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.113810 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49b094d8-e613-43f2-ad3e-47e5d882b411 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.179090 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-49b094d8-e613-43f2-ad3e-47e5d882b411 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lazy-loading 'flavor' on Instance uuid 579ddd42-b56b-41a6-bf6b-601e7b699383 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:25:54.651473 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-49b094d8-e613-43f2-ad3e-47e5d882b411 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "POST /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383/action" status: 200 len: 32 microversion: 2.1 time: 0.550062 May 13 13:25:54.658114 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 48/94] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:25:54 2022] POST /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383/action => generated 32 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 13:25:54.664181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-11b0b61e-6406-4f17-a6c4-d3c1cb608e37 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:54.664952 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-11b0b61e-6406-4f17-a6c4-d3c1cb608e37 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:54.672204 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11b0b61e-6406-4f17-a6c4-d3c1cb608e37 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.672905 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11b0b61e-6406-4f17-a6c4-d3c1cb608e37 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.674089 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11b0b61e-6406-4f17-a6c4-d3c1cb608e37 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.674719 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11b0b61e-6406-4f17-a6c4-d3c1cb608e37 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.831370 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-11b0b61e-6406-4f17-a6c4-d3c1cb608e37 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:54.839163 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-11b0b61e-6406-4f17-a6c4-d3c1cb608e37 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:54.841244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-11b0b61e-6406-4f17-a6c4-d3c1cb608e37 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:54.842384 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-11b0b61e-6406-4f17-a6c4-d3c1cb608e37 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.182913 May 13 13:25:54.842969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 49/95] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:54 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:54.849904 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c9eb1e40-2d3c-4325-9968-a84d170190e6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:54.849904 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c9eb1e40-2d3c-4325-9968-a84d170190e6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:54.853662 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c9eb1e40-2d3c-4325-9968-a84d170190e6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.854150 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c9eb1e40-2d3c-4325-9968-a84d170190e6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.855114 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c9eb1e40-2d3c-4325-9968-a84d170190e6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:54.855710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c9eb1e40-2d3c-4325-9968-a84d170190e6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:54.989494 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c9eb1e40-2d3c-4325-9968-a84d170190e6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:54.997624 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c9eb1e40-2d3c-4325-9968-a84d170190e6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.153706 May 13 13:25:54.998230 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 50/96] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:54 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:55.002596 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5302e592-2fcb-4c8a-b285-ad1725f67be1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:55.003624 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5302e592-2fcb-4c8a-b285-ad1725f67be1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:55.009455 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5302e592-2fcb-4c8a-b285-ad1725f67be1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:55.010106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5302e592-2fcb-4c8a-b285-ad1725f67be1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:55.011079 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5302e592-2fcb-4c8a-b285-ad1725f67be1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:55.011554 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5302e592-2fcb-4c8a-b285-ad1725f67be1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:55.148996 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5302e592-2fcb-4c8a-b285-ad1725f67be1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:55.156680 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5302e592-2fcb-4c8a-b285-ad1725f67be1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.157480 May 13 13:25:55.157344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 51/97] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:54 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:55.866798 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-33bcf2cd-2dc9-40e4-bce2-eab658fa65e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:55.867402 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-33bcf2cd-2dc9-40e4-bce2-eab658fa65e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:55.874392 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-33bcf2cd-2dc9-40e4-bce2-eab658fa65e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:55.875830 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-33bcf2cd-2dc9-40e4-bce2-eab658fa65e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:55.876895 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-33bcf2cd-2dc9-40e4-bce2-eab658fa65e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:55.877345 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-33bcf2cd-2dc9-40e4-bce2-eab658fa65e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:56.017215 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-33bcf2cd-2dc9-40e4-bce2-eab658fa65e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:56.025107 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-33bcf2cd-2dc9-40e4-bce2-eab658fa65e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:56.026655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-33bcf2cd-2dc9-40e4-bce2-eab658fa65e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:56.028311 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-33bcf2cd-2dc9-40e4-bce2-eab658fa65e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.166476 May 13 13:25:56.028866 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 52/98] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:55 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:25:56.033169 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-59c4debc-94ca-4b9c-8178-daff59900026 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:56.033766 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-59c4debc-94ca-4b9c-8178-daff59900026 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:56.039559 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-59c4debc-94ca-4b9c-8178-daff59900026 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:56.040009 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-59c4debc-94ca-4b9c-8178-daff59900026 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:56.040771 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-59c4debc-94ca-4b9c-8178-daff59900026 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:56.041209 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-59c4debc-94ca-4b9c-8178-daff59900026 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:56.172335 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-59c4debc-94ca-4b9c-8178-daff59900026 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:56.179656 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-59c4debc-94ca-4b9c-8178-daff59900026 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.149865 May 13 13:25:56.180235 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 53/99] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:56 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:56.184791 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9962d234-e525-4d1d-a3c0-8766b474b3ca tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:56.185668 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9962d234-e525-4d1d-a3c0-8766b474b3ca tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:56.191617 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9962d234-e525-4d1d-a3c0-8766b474b3ca tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:56.192089 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9962d234-e525-4d1d-a3c0-8766b474b3ca tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:56.192874 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9962d234-e525-4d1d-a3c0-8766b474b3ca tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:56.193314 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9962d234-e525-4d1d-a3c0-8766b474b3ca tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:56.337437 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9962d234-e525-4d1d-a3c0-8766b474b3ca tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:56.346790 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9962d234-e525-4d1d-a3c0-8766b474b3ca tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.165364 May 13 13:25:56.347574 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 54/100] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:56 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:57.046435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4a6bef89-3534-4252-b178-9c65767b138f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:57.047063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4a6bef89-3534-4252-b178-9c65767b138f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:57.053638 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a6bef89-3534-4252-b178-9c65767b138f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:57.054198 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a6bef89-3534-4252-b178-9c65767b138f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:57.054971 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a6bef89-3534-4252-b178-9c65767b138f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:57.055404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a6bef89-3534-4252-b178-9c65767b138f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:57.193953 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4a6bef89-3534-4252-b178-9c65767b138f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:57.202538 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4a6bef89-3534-4252-b178-9c65767b138f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:57.204270 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4a6bef89-3534-4252-b178-9c65767b138f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:57.205548 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4a6bef89-3534-4252-b178-9c65767b138f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.163793 May 13 13:25:57.216694 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 55/101] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:57 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:57.221391 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-25ce2df3-5b19-4cca-85e8-e30de7dab0fb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:57.222041 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-25ce2df3-5b19-4cca-85e8-e30de7dab0fb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:57.227877 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25ce2df3-5b19-4cca-85e8-e30de7dab0fb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:57.228533 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25ce2df3-5b19-4cca-85e8-e30de7dab0fb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:57.229462 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25ce2df3-5b19-4cca-85e8-e30de7dab0fb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:57.230075 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25ce2df3-5b19-4cca-85e8-e30de7dab0fb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:57.367429 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-25ce2df3-5b19-4cca-85e8-e30de7dab0fb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:57.375369 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-25ce2df3-5b19-4cca-85e8-e30de7dab0fb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.157517 May 13 13:25:57.381376 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 56/102] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:57 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:57.385432 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5d37cfce-6c23-487b-9b90-6d0e95ab09a1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:57.386322 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5d37cfce-6c23-487b-9b90-6d0e95ab09a1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:57.393642 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5d37cfce-6c23-487b-9b90-6d0e95ab09a1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:57.394124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5d37cfce-6c23-487b-9b90-6d0e95ab09a1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:57.394900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5d37cfce-6c23-487b-9b90-6d0e95ab09a1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:57.395345 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5d37cfce-6c23-487b-9b90-6d0e95ab09a1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:57.544486 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5d37cfce-6c23-487b-9b90-6d0e95ab09a1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:57.556182 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5d37cfce-6c23-487b-9b90-6d0e95ab09a1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.174607 May 13 13:25:57.556182 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 57/103] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:57 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:58.223857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d9d1a8f0-50cf-43b2-9037-1d40671b2e2a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:58.224450 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d9d1a8f0-50cf-43b2-9037-1d40671b2e2a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:58.231095 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9d1a8f0-50cf-43b2-9037-1d40671b2e2a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:58.231538 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9d1a8f0-50cf-43b2-9037-1d40671b2e2a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:58.232299 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9d1a8f0-50cf-43b2-9037-1d40671b2e2a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:58.232726 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d9d1a8f0-50cf-43b2-9037-1d40671b2e2a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:58.368174 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d9d1a8f0-50cf-43b2-9037-1d40671b2e2a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:58.377629 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d9d1a8f0-50cf-43b2-9037-1d40671b2e2a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:58.381260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d9d1a8f0-50cf-43b2-9037-1d40671b2e2a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:58.381431 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d9d1a8f0-50cf-43b2-9037-1d40671b2e2a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.160917 May 13 13:25:58.381916 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 58/104] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:58 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:58.397681 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-53e8e8b8-e163-473b-a430-0592f7e3f6fe tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:58.398453 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-53e8e8b8-e163-473b-a430-0592f7e3f6fe tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:58.405307 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-53e8e8b8-e163-473b-a430-0592f7e3f6fe tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:58.405769 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-53e8e8b8-e163-473b-a430-0592f7e3f6fe tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:58.406573 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-53e8e8b8-e163-473b-a430-0592f7e3f6fe tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:58.407015 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-53e8e8b8-e163-473b-a430-0592f7e3f6fe tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:58.606452 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-53e8e8b8-e163-473b-a430-0592f7e3f6fe tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:58.613821 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-53e8e8b8-e163-473b-a430-0592f7e3f6fe tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.219983 May 13 13:25:58.614761 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 59/105] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:58 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:58.619725 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-285b37b0-c349-4898-9a9e-99b2c5c4587b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:58.620328 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-285b37b0-c349-4898-9a9e-99b2c5c4587b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:58.626153 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-285b37b0-c349-4898-9a9e-99b2c5c4587b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:58.626605 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-285b37b0-c349-4898-9a9e-99b2c5c4587b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:58.627372 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-285b37b0-c349-4898-9a9e-99b2c5c4587b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:58.627805 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-285b37b0-c349-4898-9a9e-99b2c5c4587b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:58.784374 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-285b37b0-c349-4898-9a9e-99b2c5c4587b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:58.792005 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-285b37b0-c349-4898-9a9e-99b2c5c4587b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.175940 May 13 13:25:58.792605 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 60/106] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:58 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:25:59.399576 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-db8d2c3e-11f1-4a39-9520-2582894b5fa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:59.400204 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-db8d2c3e-11f1-4a39-9520-2582894b5fa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:59.406047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-db8d2c3e-11f1-4a39-9520-2582894b5fa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:59.406498 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-db8d2c3e-11f1-4a39-9520-2582894b5fa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:59.407258 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-db8d2c3e-11f1-4a39-9520-2582894b5fa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:59.407691 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-db8d2c3e-11f1-4a39-9520-2582894b5fa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:59.564700 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-db8d2c3e-11f1-4a39-9520-2582894b5fa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:59.573661 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-db8d2c3e-11f1-4a39-9520-2582894b5fa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:59.575273 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-db8d2c3e-11f1-4a39-9520-2582894b5fa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:59.576390 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-db8d2c3e-11f1-4a39-9520-2582894b5fa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1406 microversion: 2.20 time: 0.180721 May 13 13:25:59.578167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 61/107] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:25:59 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:25:59.630717 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ca59c3e4-400f-425f-b5b3-10748203225e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:59.631413 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ca59c3e4-400f-425f-b5b3-10748203225e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:59.637457 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ca59c3e4-400f-425f-b5b3-10748203225e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:59.637967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ca59c3e4-400f-425f-b5b3-10748203225e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:59.638762 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ca59c3e4-400f-425f-b5b3-10748203225e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:59.639237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ca59c3e4-400f-425f-b5b3-10748203225e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:59.780942 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ca59c3e4-400f-425f-b5b3-10748203225e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:59.791043 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ca59c3e4-400f-425f-b5b3-10748203225e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.163811 May 13 13:25:59.792169 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 62/108] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:59 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:25:59.810522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cc315853-bb10-47da-9f14-c1bbd505887e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:25:59.811268 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cc315853-bb10-47da-9f14-c1bbd505887e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:25:59.820044 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cc315853-bb10-47da-9f14-c1bbd505887e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:59.821703 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cc315853-bb10-47da-9f14-c1bbd505887e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:59.822693 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cc315853-bb10-47da-9f14-c1bbd505887e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:25:59.823276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cc315853-bb10-47da-9f14-c1bbd505887e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:25:59.955681 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cc315853-bb10-47da-9f14-c1bbd505887e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:25:59.963051 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cc315853-bb10-47da-9f14-c1bbd505887e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.158340 May 13 13:25:59.963621 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 63/109] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:25:59 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:00.304969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-397f072f-41c4-4eac-b3b6-6e5a66a2c25f req-1b2a75b1-b75b-405e-b339-ddab81249141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f", "name": "network-vif-plugged", "status": "completed", "tag": "14a7371d-78d5-4d51-b08a-8cd6ecaa1263"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:00.314615 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-397f072f-41c4-4eac-b3b6-6e5a66a2c25f req-1b2a75b1-b75b-405e-b339-ddab81249141 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:00.315114 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-397f072f-41c4-4eac-b3b6-6e5a66a2c25f req-1b2a75b1-b75b-405e-b339-ddab81249141 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:00.330292 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-397f072f-41c4-4eac-b3b6-6e5a66a2c25f req-1b2a75b1-b75b-405e-b339-ddab81249141 service nova] Creating event network-vif-plugged:14a7371d-78d5-4d51-b08a-8cd6ecaa1263 for instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f on hv-cinder-84159 May 13 13:26:00.336462 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-397f072f-41c4-4eac-b3b6-6e5a66a2c25f req-1b2a75b1-b75b-405e-b339-ddab81249141 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034974 May 13 13:26:00.345181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 64/110] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:00.502812 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-9a44bc54-7f67-44d0-9769-2653ee8b90cd tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "POST /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.057647 May 13 13:26:00.521383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 47/111] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:25:53 2022] POST /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84/os-volume_attachments => generated 194 bytes in 7072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:26:00.597829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-961c30bc-d30d-4e36-82ec-90c598a4b051 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:00.597829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-961c30bc-d30d-4e36-82ec-90c598a4b051 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:00.607287 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-961c30bc-d30d-4e36-82ec-90c598a4b051 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:00.607942 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-961c30bc-d30d-4e36-82ec-90c598a4b051 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:00.608979 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-961c30bc-d30d-4e36-82ec-90c598a4b051 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:00.609577 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-961c30bc-d30d-4e36-82ec-90c598a4b051 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:00.763250 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-961c30bc-d30d-4e36-82ec-90c598a4b051 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:00.774322 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-961c30bc-d30d-4e36-82ec-90c598a4b051 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:00.775857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-961c30bc-d30d-4e36-82ec-90c598a4b051 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:00.777013 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-961c30bc-d30d-4e36-82ec-90c598a4b051 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1598 microversion: 2.20 time: 0.185027 May 13 13:26:00.777559 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 65/112] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:26:00 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1598 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:26:00.797388 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1af4297f-810a-4e70-9b30-adfbf5a1a845 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:00.798382 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1af4297f-810a-4e70-9b30-adfbf5a1a845 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:00.836893 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-86d1f84b-3e28-431e-a27c-fbb4e29d598b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:00.840771 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-86d1f84b-3e28-431e-a27c-fbb4e29d598b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:00.844281 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1af4297f-810a-4e70-9b30-adfbf5a1a845 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:00.845199 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1af4297f-810a-4e70-9b30-adfbf5a1a845 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:00.848705 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1af4297f-810a-4e70-9b30-adfbf5a1a845 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:00.852967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1af4297f-810a-4e70-9b30-adfbf5a1a845 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:00.863742 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86d1f84b-3e28-431e-a27c-fbb4e29d598b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:00.864412 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86d1f84b-3e28-431e-a27c-fbb4e29d598b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:00.865568 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86d1f84b-3e28-431e-a27c-fbb4e29d598b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:00.866656 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-86d1f84b-3e28-431e-a27c-fbb4e29d598b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:01.030155 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1af4297f-810a-4e70-9b30-adfbf5a1a845 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.237695 May 13 13:26:01.037667 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 48/113] 10.222.0.25 () {60 vars in 1315 bytes} [Fri May 13 13:26:00 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-interface => generated 284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:26:01.044002 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-365ffc67-80da-4b04-b5a1-bc6cb63dbf55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:01.044968 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-365ffc67-80da-4b04-b5a1-bc6cb63dbf55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:01.051720 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-365ffc67-80da-4b04-b5a1-bc6cb63dbf55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:01.052412 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-365ffc67-80da-4b04-b5a1-bc6cb63dbf55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:01.053371 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-365ffc67-80da-4b04-b5a1-bc6cb63dbf55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:01.053837 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-365ffc67-80da-4b04-b5a1-bc6cb63dbf55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:01.124196 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-86d1f84b-3e28-431e-a27c-fbb4e29d598b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:01.131767 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-86d1f84b-3e28-431e-a27c-fbb4e29d598b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.316132 May 13 13:26:01.132341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 66/114] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:00 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:01.760336 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-365ffc67-80da-4b04-b5a1-bc6cb63dbf55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:01.776130 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-365ffc67-80da-4b04-b5a1-bc6cb63dbf55 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.736795 May 13 13:26:01.779131 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 49/115] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:01 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:02.149080 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-dcc05eb4-5e03-4125-a020-f170d3f299dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:02.150310 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-dcc05eb4-5e03-4125-a020-f170d3f299dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:02.157263 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dcc05eb4-5e03-4125-a020-f170d3f299dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:02.158039 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dcc05eb4-5e03-4125-a020-f170d3f299dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:02.159061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dcc05eb4-5e03-4125-a020-f170d3f299dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:02.159698 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dcc05eb4-5e03-4125-a020-f170d3f299dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:02.364167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-dcc05eb4-5e03-4125-a020-f170d3f299dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:02.382399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-dcc05eb4-5e03-4125-a020-f170d3f299dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.237385 May 13 13:26:02.383237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 67/116] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:02 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:02.801213 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-82a7d5fd-4ee6-455c-ab3b-ec5a565673f5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:02.802011 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-82a7d5fd-4ee6-455c-ab3b-ec5a565673f5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:02.809319 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-82a7d5fd-4ee6-455c-ab3b-ec5a565673f5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:02.810338 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-82a7d5fd-4ee6-455c-ab3b-ec5a565673f5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:02.811495 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-82a7d5fd-4ee6-455c-ab3b-ec5a565673f5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:02.811940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-82a7d5fd-4ee6-455c-ab3b-ec5a565673f5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:03.286362 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-82a7d5fd-4ee6-455c-ab3b-ec5a565673f5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:03.293936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-82a7d5fd-4ee6-455c-ab3b-ec5a565673f5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1363 microversion: 2.1 time: 0.503928 May 13 13:26:03.294603 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 50/117] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:02 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1363 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:03.402177 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-16aef2d6-27e9-4ff4-a76b-c7103e27625d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:03.408446 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-16aef2d6-27e9-4ff4-a76b-c7103e27625d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:03.415014 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-16aef2d6-27e9-4ff4-a76b-c7103e27625d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:03.415819 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-16aef2d6-27e9-4ff4-a76b-c7103e27625d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:03.418172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-16aef2d6-27e9-4ff4-a76b-c7103e27625d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:03.420170 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-16aef2d6-27e9-4ff4-a76b-c7103e27625d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:03.573099 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-9421b53b-d700-4798-8bf3-e3e9b746fb47 req-54fb73e1-932b-4ff7-969a-1fbe4f0aa728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89412841-b653-4a80-8cde-0c7a264a9c4c", "tag": "1a4cef43-4ad0-41f0-9857-11ea57340642"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:03.594969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-9421b53b-d700-4798-8bf3-e3e9b746fb47 req-54fb73e1-932b-4ff7-969a-1fbe4f0aa728 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:03.595357 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-9421b53b-d700-4798-8bf3-e3e9b746fb47 req-54fb73e1-932b-4ff7-969a-1fbe4f0aa728 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:03.613055 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-9421b53b-d700-4798-8bf3-e3e9b746fb47 req-54fb73e1-932b-4ff7-969a-1fbe4f0aa728 service nova] Creating event network-changed:1a4cef43-4ad0-41f0-9857-11ea57340642 for instance 89412841-b653-4a80-8cde-0c7a264a9c4c on hv-cinder-84159 May 13 13:26:03.620730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-9421b53b-d700-4798-8bf3-e3e9b746fb47 req-54fb73e1-932b-4ff7-969a-1fbe4f0aa728 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049487 May 13 13:26:03.620730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 51/118] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:03.646483 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-16aef2d6-27e9-4ff4-a76b-c7103e27625d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:03.656517 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-16aef2d6-27e9-4ff4-a76b-c7103e27625d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.259565 May 13 13:26:03.657272 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 68/119] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:03 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:04.311580 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3a42cabc-f033-4b23-81bc-ba42866af71b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:04.312277 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3a42cabc-f033-4b23-81bc-ba42866af71b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:04.318930 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3a42cabc-f033-4b23-81bc-ba42866af71b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:04.336176 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3a42cabc-f033-4b23-81bc-ba42866af71b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:04.338998 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3a42cabc-f033-4b23-81bc-ba42866af71b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:04.340360 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3a42cabc-f033-4b23-81bc-ba42866af71b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:04.682863 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a7e75bf0-8f8a-43bf-827a-087f4dcb2e90 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:04.684135 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a7e75bf0-8f8a-43bf-827a-087f4dcb2e90 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:04.694385 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a7e75bf0-8f8a-43bf-827a-087f4dcb2e90 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:04.694965 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a7e75bf0-8f8a-43bf-827a-087f4dcb2e90 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:04.697593 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a7e75bf0-8f8a-43bf-827a-087f4dcb2e90 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:04.698284 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a7e75bf0-8f8a-43bf-827a-087f4dcb2e90 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:04.944830 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a7e75bf0-8f8a-43bf-827a-087f4dcb2e90 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:04.953739 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a7e75bf0-8f8a-43bf-827a-087f4dcb2e90 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.275099 May 13 13:26:04.954834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 69/120] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:04 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:05.002579 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3a42cabc-f033-4b23-81bc-ba42866af71b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:05.017179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3a42cabc-f033-4b23-81bc-ba42866af71b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1549 microversion: 2.1 time: 0.710019 May 13 13:26:05.018606 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 52/121] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:04 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1549 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:05.034889 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c172cbe1-96a2-4fb4-ac4e-b1909d7d290f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:05.035388 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c172cbe1-96a2-4fb4-ac4e-b1909d7d290f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:05.045108 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c172cbe1-96a2-4fb4-ac4e-b1909d7d290f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:05.047025 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c172cbe1-96a2-4fb4-ac4e-b1909d7d290f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:05.047845 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c172cbe1-96a2-4fb4-ac4e-b1909d7d290f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:05.048297 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c172cbe1-96a2-4fb4-ac4e-b1909d7d290f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:05.184807 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c172cbe1-96a2-4fb4-ac4e-b1909d7d290f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154031 May 13 13:26:05.185457 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 70/122] 10.222.0.25 () {58 vars in 1274 bytes} [Fri May 13 13:26:05 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:05.975369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9879f0ca-3ece-41f9-98f2-d703d5c50437 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:05.981695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-9879f0ca-3ece-41f9-98f2-d703d5c50437 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:05.989031 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9879f0ca-3ece-41f9-98f2-d703d5c50437 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:05.989885 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9879f0ca-3ece-41f9-98f2-d703d5c50437 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:05.991350 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9879f0ca-3ece-41f9-98f2-d703d5c50437 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:05.992085 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9879f0ca-3ece-41f9-98f2-d703d5c50437 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:06.193967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-9879f0ca-3ece-41f9-98f2-d703d5c50437 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:06.202860 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-9879f0ca-3ece-41f9-98f2-d703d5c50437 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.234358 May 13 13:26:06.203522 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 53/123] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:05 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:06.885676 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-05f0f63c-d066-432c-b2c7-77a95871e63c req-7aa3bb75-259c-48f0-889c-447f350e005b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f", "tag": "14a7371d-78d5-4d51-b08a-8cd6ecaa1263"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:06.894602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-05f0f63c-d066-432c-b2c7-77a95871e63c req-7aa3bb75-259c-48f0-889c-447f350e005b service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:06.895271 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-05f0f63c-d066-432c-b2c7-77a95871e63c req-7aa3bb75-259c-48f0-889c-447f350e005b service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:06.909937 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-05f0f63c-d066-432c-b2c7-77a95871e63c req-7aa3bb75-259c-48f0-889c-447f350e005b service nova] Creating event network-changed:14a7371d-78d5-4d51-b08a-8cd6ecaa1263 for instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f on hv-cinder-84159 May 13 13:26:06.916411 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-05f0f63c-d066-432c-b2c7-77a95871e63c req-7aa3bb75-259c-48f0-889c-447f350e005b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034717 May 13 13:26:06.921967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 71/124] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:07.221750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8ab11a9e-0058-40a0-b919-1c711f011432 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:07.222706 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8ab11a9e-0058-40a0-b919-1c711f011432 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:07.233095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8ab11a9e-0058-40a0-b919-1c711f011432 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:07.233558 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8ab11a9e-0058-40a0-b919-1c711f011432 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:07.234389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8ab11a9e-0058-40a0-b919-1c711f011432 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:07.234818 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8ab11a9e-0058-40a0-b919-1c711f011432 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:07.486636 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-8ab11a9e-0058-40a0-b919-1c711f011432 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:07.505316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8ab11a9e-0058-40a0-b919-1c711f011432 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.286559 May 13 13:26:07.517151 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 54/125] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:07 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:08.524343 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2a22fd92-75cb-424d-ab1e-8b73dd625b52 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:08.525063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2a22fd92-75cb-424d-ab1e-8b73dd625b52 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:08.531755 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a22fd92-75cb-424d-ab1e-8b73dd625b52 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:08.532193 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a22fd92-75cb-424d-ab1e-8b73dd625b52 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:08.532958 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a22fd92-75cb-424d-ab1e-8b73dd625b52 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:08.533411 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2a22fd92-75cb-424d-ab1e-8b73dd625b52 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:08.670082 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2a22fd92-75cb-424d-ab1e-8b73dd625b52 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:08.682232 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2a22fd92-75cb-424d-ab1e-8b73dd625b52 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.155220 May 13 13:26:08.682232 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 72/126] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:08 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:09.696705 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-765cc265-59b3-45a2-b138-3fa56fe6be16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:09.697312 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-765cc265-59b3-45a2-b138-3fa56fe6be16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:09.703638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-765cc265-59b3-45a2-b138-3fa56fe6be16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:09.704074 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-765cc265-59b3-45a2-b138-3fa56fe6be16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:09.704848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-765cc265-59b3-45a2-b138-3fa56fe6be16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:09.705288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-765cc265-59b3-45a2-b138-3fa56fe6be16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:09.848459 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-765cc265-59b3-45a2-b138-3fa56fe6be16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:09.855822 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-765cc265-59b3-45a2-b138-3fa56fe6be16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.163193 May 13 13:26:09.856394 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 55/127] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:09 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:10.876449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e7601349-8b38-44e6-943c-4a8390304253 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:10.877073 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e7601349-8b38-44e6-943c-4a8390304253 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:10.885463 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e7601349-8b38-44e6-943c-4a8390304253 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:10.886052 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e7601349-8b38-44e6-943c-4a8390304253 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:10.886965 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e7601349-8b38-44e6-943c-4a8390304253 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:10.887495 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e7601349-8b38-44e6-943c-4a8390304253 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:11.037366 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e7601349-8b38-44e6-943c-4a8390304253 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:11.045152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e7601349-8b38-44e6-943c-4a8390304253 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.176607 May 13 13:26:11.045727 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 73/128] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:10 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:11.767009 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0d26d203-5e00-4ceb-afe4-811657838bbb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:11.767585 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0d26d203-5e00-4ceb-afe4-811657838bbb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:11.777479 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0d26d203-5e00-4ceb-afe4-811657838bbb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:11.778234 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0d26d203-5e00-4ceb-afe4-811657838bbb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:11.779026 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0d26d203-5e00-4ceb-afe4-811657838bbb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:11.779624 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0d26d203-5e00-4ceb-afe4-811657838bbb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:11.806437 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0d26d203-5e00-4ceb-afe4-811657838bbb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Going to try to terminate instance {{(pid=117602) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:26:12.062520 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6c90bf0d-9e28-42bc-a1ec-98874449ff96 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:12.063215 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6c90bf0d-9e28-42bc-a1ec-98874449ff96 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:12.069394 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6c90bf0d-9e28-42bc-a1ec-98874449ff96 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:12.069880 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6c90bf0d-9e28-42bc-a1ec-98874449ff96 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:12.070664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6c90bf0d-9e28-42bc-a1ec-98874449ff96 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:12.071360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6c90bf0d-9e28-42bc-a1ec-98874449ff96 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:12.182970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0d26d203-5e00-4ceb-afe4-811657838bbb tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 204 len: 0 microversion: 2.1 time: 0.419592 May 13 13:26:12.184165 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 56/129] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:26:11 2022] DELETE /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:26:12.192864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-be462c99-af26-48ae-91e5-3d9543c332bf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:12.194760 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-be462c99-af26-48ae-91e5-3d9543c332bf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:12.200118 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-be462c99-af26-48ae-91e5-3d9543c332bf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:12.200566 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-be462c99-af26-48ae-91e5-3d9543c332bf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:12.201334 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-be462c99-af26-48ae-91e5-3d9543c332bf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:12.201766 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-be462c99-af26-48ae-91e5-3d9543c332bf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:12.208886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6c90bf0d-9e28-42bc-a1ec-98874449ff96 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:12.216228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6c90bf0d-9e28-42bc-a1ec-98874449ff96 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.158117 May 13 13:26:12.216801 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 74/130] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:12 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:12.335312 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-be462c99-af26-48ae-91e5-3d9543c332bf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:12.343662 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-be462c99-af26-48ae-91e5-3d9543c332bf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1553 microversion: 2.1 time: 0.155090 May 13 13:26:12.344360 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 57/131] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:12 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:13.232370 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1ac3b2a1-689e-4898-ae09-dcb9ef220aab tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:13.232972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1ac3b2a1-689e-4898-ae09-dcb9ef220aab tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:13.242128 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1ac3b2a1-689e-4898-ae09-dcb9ef220aab tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:13.242128 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1ac3b2a1-689e-4898-ae09-dcb9ef220aab tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:13.242128 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1ac3b2a1-689e-4898-ae09-dcb9ef220aab tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:13.242128 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1ac3b2a1-689e-4898-ae09-dcb9ef220aab tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:13.361641 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-86a4ed8c-58c3-4101-b2c6-6d8ed4a35e5b tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:13.362902 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-86a4ed8c-58c3-4101-b2c6-6d8ed4a35e5b tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:13.370029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-86a4ed8c-58c3-4101-b2c6-6d8ed4a35e5b tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:13.371165 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-86a4ed8c-58c3-4101-b2c6-6d8ed4a35e5b tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:13.372150 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-86a4ed8c-58c3-4101-b2c6-6d8ed4a35e5b tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:13.372593 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-86a4ed8c-58c3-4101-b2c6-6d8ed4a35e5b tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:13.379464 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1ac3b2a1-689e-4898-ae09-dcb9ef220aab tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:13.398208 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1ac3b2a1-689e-4898-ae09-dcb9ef220aab tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.169645 May 13 13:26:13.398793 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 75/132] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:13 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:13.510622 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-86a4ed8c-58c3-4101-b2c6-6d8ed4a35e5b tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:13.518925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-86a4ed8c-58c3-4101-b2c6-6d8ed4a35e5b tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1553 microversion: 2.1 time: 0.161683 May 13 13:26:13.522041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 58/133] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:13 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:14.415641 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d6a538af-7715-40ef-a697-32febef48e9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:14.416780 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d6a538af-7715-40ef-a697-32febef48e9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:14.422714 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d6a538af-7715-40ef-a697-32febef48e9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:14.423171 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d6a538af-7715-40ef-a697-32febef48e9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:14.423939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d6a538af-7715-40ef-a697-32febef48e9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:14.424378 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d6a538af-7715-40ef-a697-32febef48e9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:14.537542 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-bc7fadf0-a987-4217-8349-42766a460916 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:14.538214 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-bc7fadf0-a987-4217-8349-42766a460916 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:14.555848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bc7fadf0-a987-4217-8349-42766a460916 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:14.558424 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bc7fadf0-a987-4217-8349-42766a460916 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:14.561447 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bc7fadf0-a987-4217-8349-42766a460916 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:14.561908 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bc7fadf0-a987-4217-8349-42766a460916 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:14.563304 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d6a538af-7715-40ef-a697-32febef48e9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:14.572035 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d6a538af-7715-40ef-a697-32febef48e9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.159495 May 13 13:26:14.581162 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 76/134] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:14 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:14.706011 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bc7fadf0-a987-4217-8349-42766a460916 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:14.713847 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-bc7fadf0-a987-4217-8349-42766a460916 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1553 microversion: 2.1 time: 0.180764 May 13 13:26:14.714425 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 59/135] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:14 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:15.588599 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fbee844d-9eae-41cd-95e0-1916ac8c8af0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:15.589221 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fbee844d-9eae-41cd-95e0-1916ac8c8af0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:15.595745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fbee844d-9eae-41cd-95e0-1916ac8c8af0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:15.600930 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fbee844d-9eae-41cd-95e0-1916ac8c8af0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:15.600930 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fbee844d-9eae-41cd-95e0-1916ac8c8af0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:15.600930 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fbee844d-9eae-41cd-95e0-1916ac8c8af0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:15.733241 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7da10407-7590-4c04-8915-9c94e999cbfe tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:15.734990 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7da10407-7590-4c04-8915-9c94e999cbfe tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:15.737761 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fbee844d-9eae-41cd-95e0-1916ac8c8af0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:15.744826 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7da10407-7590-4c04-8915-9c94e999cbfe tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:15.746158 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7da10407-7590-4c04-8915-9c94e999cbfe tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:15.746313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fbee844d-9eae-41cd-95e0-1916ac8c8af0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.160402 May 13 13:26:15.747650 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7da10407-7590-4c04-8915-9c94e999cbfe tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:15.748241 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7da10407-7590-4c04-8915-9c94e999cbfe tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:15.755886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 77/136] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:15 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:15.884862 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-7da10407-7590-4c04-8915-9c94e999cbfe tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:15.893456 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7da10407-7590-4c04-8915-9c94e999cbfe tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1553 microversion: 2.1 time: 0.166344 May 13 13:26:15.894040 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 60/137] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:15 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:16.763410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-63cedec4-7042-4437-9d4d-28727cd32d2c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:16.764033 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-63cedec4-7042-4437-9d4d-28727cd32d2c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:16.770018 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-63cedec4-7042-4437-9d4d-28727cd32d2c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:16.770474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-63cedec4-7042-4437-9d4d-28727cd32d2c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:16.771280 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-63cedec4-7042-4437-9d4d-28727cd32d2c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:16.771744 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-63cedec4-7042-4437-9d4d-28727cd32d2c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:16.900750 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-63cedec4-7042-4437-9d4d-28727cd32d2c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:16.911362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-63cedec4-7042-4437-9d4d-28727cd32d2c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.152136 May 13 13:26:16.912130 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8319fd75-dfa4-4a14-8c00-1c3c1c690a88 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:16.912868 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8319fd75-dfa4-4a14-8c00-1c3c1c690a88 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:16.919471 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8319fd75-dfa4-4a14-8c00-1c3c1c690a88 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:16.919990 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8319fd75-dfa4-4a14-8c00-1c3c1c690a88 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:16.920986 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8319fd75-dfa4-4a14-8c00-1c3c1c690a88 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:16.921379 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 78/138] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:16 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:16.921609 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8319fd75-dfa4-4a14-8c00-1c3c1c690a88 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:17.060974 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-8319fd75-dfa4-4a14-8c00-1c3c1c690a88 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:17.068810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8319fd75-dfa4-4a14-8c00-1c3c1c690a88 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1553 microversion: 2.1 time: 0.161322 May 13 13:26:17.069393 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 61/139] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:16 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:17.928974 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9192639f-32c2-4130-b295-00749c4a3514 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:17.929507 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9192639f-32c2-4130-b295-00749c4a3514 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:17.935709 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9192639f-32c2-4130-b295-00749c4a3514 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:17.936165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9192639f-32c2-4130-b295-00749c4a3514 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:17.936940 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9192639f-32c2-4130-b295-00749c4a3514 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:17.937387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9192639f-32c2-4130-b295-00749c4a3514 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:18.064891 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9192639f-32c2-4130-b295-00749c4a3514 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:18.072578 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9192639f-32c2-4130-b295-00749c4a3514 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.147738 May 13 13:26:18.073319 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 79/140] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:17 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:18.085488 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6149e210-b10e-4861-ac66-582ccacd7843 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:18.086131 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6149e210-b10e-4861-ac66-582ccacd7843 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:18.093137 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6149e210-b10e-4861-ac66-582ccacd7843 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:18.097060 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6149e210-b10e-4861-ac66-582ccacd7843 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:18.097060 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6149e210-b10e-4861-ac66-582ccacd7843 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:18.097060 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6149e210-b10e-4861-ac66-582ccacd7843 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:18.226648 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6149e210-b10e-4861-ac66-582ccacd7843 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:18.234355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6149e210-b10e-4861-ac66-582ccacd7843 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1553 microversion: 2.1 time: 0.152879 May 13 13:26:18.234960 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 62/141] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:18 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:19.090301 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cacb64cc-32bb-470b-b11c-53fa57741b86 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:19.091118 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cacb64cc-32bb-470b-b11c-53fa57741b86 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:19.097209 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cacb64cc-32bb-470b-b11c-53fa57741b86 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:19.097982 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cacb64cc-32bb-470b-b11c-53fa57741b86 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:19.099054 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cacb64cc-32bb-470b-b11c-53fa57741b86 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:19.099708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cacb64cc-32bb-470b-b11c-53fa57741b86 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:19.253020 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d7be4adc-ba60-4de8-997e-6817d3b705e0 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:19.254478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d7be4adc-ba60-4de8-997e-6817d3b705e0 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:19.262634 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d7be4adc-ba60-4de8-997e-6817d3b705e0 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:19.263330 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d7be4adc-ba60-4de8-997e-6817d3b705e0 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:19.264304 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d7be4adc-ba60-4de8-997e-6817d3b705e0 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:19.264905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d7be4adc-ba60-4de8-997e-6817d3b705e0 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:19.369519 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cacb64cc-32bb-470b-b11c-53fa57741b86 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:19.381027 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cacb64cc-32bb-470b-b11c-53fa57741b86 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.294616 May 13 13:26:19.382903 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 80/142] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:19 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:19.443012 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d7be4adc-ba60-4de8-997e-6817d3b705e0 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:19.451347 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d7be4adc-ba60-4de8-997e-6817d3b705e0 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1553 microversion: 2.1 time: 0.203917 May 13 13:26:19.452046 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 63/143] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:19 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:20.006085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-ca0bf65c-15d3-4098-ae17-bf36bf13d28b req-8de6f20c-8ee2-4b07-a241-aca9005b98a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8fe7e67-a111-4f6b-9ddf-e13a0028db84", "name": "network-vif-deleted", "tag": "a4f23c78-8204-4a15-829a-414f56fa3b61"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:20.017129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ca0bf65c-15d3-4098-ae17-bf36bf13d28b req-8de6f20c-8ee2-4b07-a241-aca9005b98a8 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:20.017582 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ca0bf65c-15d3-4098-ae17-bf36bf13d28b req-8de6f20c-8ee2-4b07-a241-aca9005b98a8 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:20.029052 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-ca0bf65c-15d3-4098-ae17-bf36bf13d28b req-8de6f20c-8ee2-4b07-a241-aca9005b98a8 service nova] Creating event network-vif-deleted:a4f23c78-8204-4a15-829a-414f56fa3b61 for instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 on hv-cinder-84159 May 13 13:26:20.033989 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-ca0bf65c-15d3-4098-ae17-bf36bf13d28b req-8de6f20c-8ee2-4b07-a241-aca9005b98a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031858 May 13 13:26:20.034561 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 81/144] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:20.398628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-63eebb5c-a84e-4716-ac1f-a3ce48906aaf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:20.399272 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-63eebb5c-a84e-4716-ac1f-a3ce48906aaf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:20.406088 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-63eebb5c-a84e-4716-ac1f-a3ce48906aaf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:20.406546 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-63eebb5c-a84e-4716-ac1f-a3ce48906aaf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:20.407327 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-63eebb5c-a84e-4716-ac1f-a3ce48906aaf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:20.407768 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-63eebb5c-a84e-4716-ac1f-a3ce48906aaf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:20.469328 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-966051b3-61e0-434f-9111-6dc3f1964b7c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:20.470728 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-966051b3-61e0-434f-9111-6dc3f1964b7c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:20.477062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-966051b3-61e0-434f-9111-6dc3f1964b7c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:20.477633 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-966051b3-61e0-434f-9111-6dc3f1964b7c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:20.478483 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-966051b3-61e0-434f-9111-6dc3f1964b7c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:20.479111 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-966051b3-61e0-434f-9111-6dc3f1964b7c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:20.541885 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-966051b3-61e0-434f-9111-6dc3f1964b7c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:20.542812 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-63eebb5c-a84e-4716-ac1f-a3ce48906aaf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:20.550800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-966051b3-61e0-434f-9111-6dc3f1964b7c tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1346 microversion: 2.1 time: 0.086097 May 13 13:26:20.550942 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-63eebb5c-a84e-4716-ac1f-a3ce48906aaf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.155633 May 13 13:26:20.551313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 82/145] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:20 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:20.553818 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 64/146] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:20 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:21.567416 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-25333cac-fda3-4e4b-b911-cc71ec81eb82 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:21.567917 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-cab0dfd6-7b76-493e-a76a-cea9672bfed2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:21.568285 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-25333cac-fda3-4e4b-b911-cc71ec81eb82 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:21.568376 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-cab0dfd6-7b76-493e-a76a-cea9672bfed2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:21.574776 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25333cac-fda3-4e4b-b911-cc71ec81eb82 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:21.575214 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25333cac-fda3-4e4b-b911-cc71ec81eb82 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:21.575537 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cab0dfd6-7b76-493e-a76a-cea9672bfed2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:21.575964 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25333cac-fda3-4e4b-b911-cc71ec81eb82 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:21.576106 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cab0dfd6-7b76-493e-a76a-cea9672bfed2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:21.576391 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25333cac-fda3-4e4b-b911-cc71ec81eb82 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:21.577029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cab0dfd6-7b76-493e-a76a-cea9672bfed2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:21.577539 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cab0dfd6-7b76-493e-a76a-cea9672bfed2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:21.605292 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25333cac-fda3-4e4b-b911-cc71ec81eb82 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:21.605742 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25333cac-fda3-4e4b-b911-cc71ec81eb82 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:21.606216 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-25333cac-fda3-4e4b-b911-cc71ec81eb82 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lazy-loading 'fault' on Instance uuid c8fe7e67-a111-4f6b-9ddf-e13a0028db84 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:26:21.649178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-25333cac-fda3-4e4b-b911-cc71ec81eb82 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80623f3527844489a5e31a786080fa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65563e9192834a848521c69c7c80f078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:21.657284 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-25333cac-fda3-4e4b-b911-cc71ec81eb82 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 200 len: 1351 microversion: 2.1 time: 0.093729 May 13 13:26:21.657883 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 83/147] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:21 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:21.711276 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-cab0dfd6-7b76-493e-a76a-cea9672bfed2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:21.719332 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-cab0dfd6-7b76-493e-a76a-cea9672bfed2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.155715 May 13 13:26:21.719895 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 65/148] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:21 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:22.674971 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-84299e04-6fac-4530-ab4e-404725d91bbf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:22.676046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-84299e04-6fac-4530-ab4e-404725d91bbf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:22.682831 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-84299e04-6fac-4530-ab4e-404725d91bbf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:22.683521 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-84299e04-6fac-4530-ab4e-404725d91bbf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:22.685213 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-84299e04-6fac-4530-ab4e-404725d91bbf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:22.685501 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-84299e04-6fac-4530-ab4e-404725d91bbf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:22.701126 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-84299e04-6fac-4530-ab4e-404725d91bbf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] HTTP exception thrown: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-84299e04-6fac-4530-ab4e-404725d91bbf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Request method failure captured: May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 HTTP/1.1 May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflw3RlzpD92E-T9x2FJxLLN-9pY66eN4QwZbFnCxrESR1XW6bp_tzlPPulHMKyuze5tctusDxw_bH3DEF4fsTXtFR4PqVW2eIktnj4Z_c2i1i02E8OvibVG5Pb6rJcwXEeWV8himdBH13tC1AlMQsUYExiCo896Q-VO9tWQY_tkkYeM May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 65563e9192834a848521c69c7c80f078 May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-DeleteServersTestJSON-704022062 May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:26:22.710061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:26:22.711535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65563e9192834a848521c69c7c80f078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65563e9192834a848521c69c7c80f078", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65563e9192834a848521c69c7c80f078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65563e9192834a848521c69c7c80f078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:26:22.711535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-DeleteServersTestJSON-704022062 May 13 13:26:22.711535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 65563e9192834a848521c69c7c80f078 May 13 13:26:22.711535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-DeleteServersTestJSON-704022062 May 13 13:26:22.711535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-DeleteServersTestJSON-704022062-project May 13 13:26:22.711535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:26:22.711535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:26:22.711535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 80623f3527844489a5e31a786080fa10 May 13 13:26:22.711535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-DeleteServersTestJSON-704022062-project May 13 13:26:22.711535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:26:22.711535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:22.711535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'c8fe7e67-a111-4f6b-9ddf-e13a0028db84'} May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:26:22.712197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:22.713275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:22.714354 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-84299e04-6fac-4530-ab4e-404725d91bbf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Returning 404 to user: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:26:22.714354 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-84299e04-6fac-4530-ab4e-404725d91bbf tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 404 len: 111 microversion: 2.1 time: 0.036731 May 13 13:26:22.714354 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 84/149] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:22 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:26:22.737822 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-649b822d-7895-4e06-a459-51961d35571d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:22.738431 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-649b822d-7895-4e06-a459-51961d35571d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:22.744908 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-649b822d-7895-4e06-a459-51961d35571d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:22.745356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-649b822d-7895-4e06-a459-51961d35571d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:22.746738 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-649b822d-7895-4e06-a459-51961d35571d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:22.747178 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-649b822d-7895-4e06-a459-51961d35571d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:22.811594 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8f1e49b6-4f8c-4d31-aa8c-7df808599664 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:22.812599 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8f1e49b6-4f8c-4d31-aa8c-7df808599664 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:22.818565 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8f1e49b6-4f8c-4d31-aa8c-7df808599664 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:22.818995 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8f1e49b6-4f8c-4d31-aa8c-7df808599664 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:22.819767 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8f1e49b6-4f8c-4d31-aa8c-7df808599664 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:22.820210 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8f1e49b6-4f8c-4d31-aa8c-7df808599664 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:22.833381 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-8f1e49b6-4f8c-4d31-aa8c-7df808599664 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] HTTP exception thrown: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8f1e49b6-4f8c-4d31-aa8c-7df808599664 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Request method failure captured: May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84/os-volume_attachments HTTP/1.1 May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflw3RlzpD92E-T9x2FJxLLN-9pY66eN4QwZbFnCxrESR1XW6bp_tzlPPulHMKyuze5tctusDxw_bH3DEF4fsTXtFR4PqVW2eIktnj4Z_c2i1i02E8OvibVG5Pb6rJcwXEeWV8himdBH13tC1AlMQsUYExiCo896Q-VO9tWQY_tkkYeM May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 65563e9192834a848521c69c7c80f078 May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-DeleteServersTestJSON-704022062 May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:26:22.834957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:26:22.836360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65563e9192834a848521c69c7c80f078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65563e9192834a848521c69c7c80f078", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65563e9192834a848521c69c7c80f078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65563e9192834a848521c69c7c80f078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:26:22.836360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-DeleteServersTestJSON-704022062 May 13 13:26:22.836360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 65563e9192834a848521c69c7c80f078 May 13 13:26:22.836360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-DeleteServersTestJSON-704022062 May 13 13:26:22.836360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-DeleteServersTestJSON-704022062-project May 13 13:26:22.836360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:26:22.836360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:26:22.836360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 80623f3527844489a5e31a786080fa10 May 13 13:26:22.836360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-DeleteServersTestJSON-704022062-project May 13 13:26:22.836360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:26:22.836360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:22.836360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'server_id': 'c8fe7e67-a111-4f6b-9ddf-e13a0028db84'} May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:26:22.837105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:22.838404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:22.840076 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8f1e49b6-4f8c-4d31-aa8c-7df808599664 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Returning 404 to user: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:26:22.840076 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8f1e49b6-4f8c-4d31-aa8c-7df808599664 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031556 May 13 13:26:22.840076 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 85/150] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:26:22 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:26:22.888874 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-649b822d-7895-4e06-a459-51961d35571d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:22.896074 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-649b822d-7895-4e06-a459-51961d35571d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.162008 May 13 13:26:22.896646 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 66/151] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:22 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:23.913414 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0709bc39-955f-42ac-8d22-5b7590401c06 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:23.914115 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0709bc39-955f-42ac-8d22-5b7590401c06 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:23.920621 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0709bc39-955f-42ac-8d22-5b7590401c06 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:23.921202 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0709bc39-955f-42ac-8d22-5b7590401c06 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:23.922092 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0709bc39-955f-42ac-8d22-5b7590401c06 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:23.922438 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0709bc39-955f-42ac-8d22-5b7590401c06 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:24.072957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0709bc39-955f-42ac-8d22-5b7590401c06 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:24.091265 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0709bc39-955f-42ac-8d22-5b7590401c06 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.181828 May 13 13:26:24.094581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 86/152] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:23 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:24.321059 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-dceb6631-7b59-4942-8dee-d38096bffbbc tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:24.321830 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-dceb6631-7b59-4942-8dee-d38096bffbbc tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:24.327734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dceb6631-7b59-4942-8dee-d38096bffbbc tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:24.328192 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dceb6631-7b59-4942-8dee-d38096bffbbc tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:24.329258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dceb6631-7b59-4942-8dee-d38096bffbbc tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:24.329760 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dceb6631-7b59-4942-8dee-d38096bffbbc tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:24.342975 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-dceb6631-7b59-4942-8dee-d38096bffbbc tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] HTTP exception thrown: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-dceb6631-7b59-4942-8dee-d38096bffbbc tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Request method failure captured: May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: DELETE /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 HTTP/1.1 May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflw3RlzpD92E-T9x2FJxLLN-9pY66eN4QwZbFnCxrESR1XW6bp_tzlPPulHMKyuze5tctusDxw_bH3DEF4fsTXtFR4PqVW2eIktnj4Z_c2i1i02E8OvibVG5Pb6rJcwXEeWV8himdBH13tC1AlMQsUYExiCo896Q-VO9tWQY_tkkYeM May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 65563e9192834a848521c69c7c80f078 May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-DeleteServersTestJSON-704022062 May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:26:24.347604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:26:24.348969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65563e9192834a848521c69c7c80f078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65563e9192834a848521c69c7c80f078", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65563e9192834a848521c69c7c80f078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65563e9192834a848521c69c7c80f078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:26:24.348969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-DeleteServersTestJSON-704022062 May 13 13:26:24.348969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 65563e9192834a848521c69c7c80f078 May 13 13:26:24.348969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-DeleteServersTestJSON-704022062 May 13 13:26:24.348969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-DeleteServersTestJSON-704022062-project May 13 13:26:24.348969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:26:24.348969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:26:24.348969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 80623f3527844489a5e31a786080fa10 May 13 13:26:24.348969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-DeleteServersTestJSON-704022062-project May 13 13:26:24.348969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:26:24.348969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:24.348969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': 'c8fe7e67-a111-4f6b-9ddf-e13a0028db84'} May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:26:24.349848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:24.351117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:26:24.352483 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-dceb6631-7b59-4942-8dee-d38096bffbbc tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Returning 404 to user: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:26:24.352483 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-dceb6631-7b59-4942-8dee-d38096bffbbc tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 404 len: 111 microversion: 2.1 time: 0.031945 May 13 13:26:24.352483 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 67/153] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:26:24 2022] DELETE /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:26:24.358535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1804e331-5005-465c-96d8-936f94b52852 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:24.359176 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1804e331-5005-465c-96d8-936f94b52852 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] [instance: c8fe7e67-a111-4f6b-9ddf-e13a0028db84] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:24.365425 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1804e331-5005-465c-96d8-936f94b52852 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:24.370558 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1804e331-5005-465c-96d8-936f94b52852 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:24.370558 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1804e331-5005-465c-96d8-936f94b52852 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:24.370558 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1804e331-5005-465c-96d8-936f94b52852 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:24.382648 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-1804e331-5005-465c-96d8-936f94b52852 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] HTTP exception thrown: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1804e331-5005-465c-96d8-936f94b52852 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Request method failure captured: May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 HTTP/1.1 May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflw3RlzpD92E-T9x2FJxLLN-9pY66eN4QwZbFnCxrESR1XW6bp_tzlPPulHMKyuze5tctusDxw_bH3DEF4fsTXtFR4PqVW2eIktnj4Z_c2i1i02E8OvibVG5Pb6rJcwXEeWV8himdBH13tC1AlMQsUYExiCo896Q-VO9tWQY_tkkYeM May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 65563e9192834a848521c69c7c80f078 May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-DeleteServersTestJSON-704022062 May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:26:24.384341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:26:24.385745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65563e9192834a848521c69c7c80f078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_65563e9192834a848521c69c7c80f078", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/65563e9192834a848521c69c7c80f078"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/65563e9192834a848521c69c7c80f078"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:26:24.385745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-DeleteServersTestJSON-704022062 May 13 13:26:24.385745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 65563e9192834a848521c69c7c80f078 May 13 13:26:24.385745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-DeleteServersTestJSON-704022062 May 13 13:26:24.385745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-DeleteServersTestJSON-704022062-project May 13 13:26:24.385745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:26:24.385745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:26:24.385745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 80623f3527844489a5e31a786080fa10 May 13 13:26:24.385745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-DeleteServersTestJSON-704022062-project May 13 13:26:24.385745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:26:24.385745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:24.385745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'c8fe7e67-a111-4f6b-9ddf-e13a0028db84'} May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:26:24.386803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. May 13 13:26:24.388746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:24.390265 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1804e331-5005-465c-96d8-936f94b52852 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] Returning 404 to user: Instance c8fe7e67-a111-4f6b-9ddf-e13a0028db84 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:26:24.390265 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1804e331-5005-465c-96d8-936f94b52852 tempest-DeleteServersTestJSON-704022062 tempest-DeleteServersTestJSON-704022062-project] 10.222.0.25 "GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84" status: 404 len: 111 microversion: 2.1 time: 0.032202 May 13 13:26:24.390265 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 87/154] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:24 2022] GET /compute/v2.1/servers/c8fe7e67-a111-4f6b-9ddf-e13a0028db84 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:26:25.111655 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-117bc1b1-9c03-4a43-9c02-74dfe4e1f9bc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:25.112497 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-117bc1b1-9c03-4a43-9c02-74dfe4e1f9bc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:25.123787 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-117bc1b1-9c03-4a43-9c02-74dfe4e1f9bc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:25.123787 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-117bc1b1-9c03-4a43-9c02-74dfe4e1f9bc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:25.124503 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-117bc1b1-9c03-4a43-9c02-74dfe4e1f9bc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:25.125040 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-117bc1b1-9c03-4a43-9c02-74dfe4e1f9bc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:25.289716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-117bc1b1-9c03-4a43-9c02-74dfe4e1f9bc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:25.298072 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-117bc1b1-9c03-4a43-9c02-74dfe4e1f9bc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.190920 May 13 13:26:25.298737 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 68/155] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:25 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:26.319148 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6f15f8f2-af6e-4044-a74f-f8d9815d3969 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:26.319605 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6f15f8f2-af6e-4044-a74f-f8d9815d3969 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:26.327031 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6f15f8f2-af6e-4044-a74f-f8d9815d3969 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:26.327489 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6f15f8f2-af6e-4044-a74f-f8d9815d3969 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:26.328616 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6f15f8f2-af6e-4044-a74f-f8d9815d3969 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:26.329527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6f15f8f2-af6e-4044-a74f-f8d9815d3969 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:26.480307 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6f15f8f2-af6e-4044-a74f-f8d9815d3969 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:26.487329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6f15f8f2-af6e-4044-a74f-f8d9815d3969 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.172746 May 13 13:26:26.487935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 88/156] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:26 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:27.516714 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-08b63b0f-7f45-4828-bf5e-faccc66a1b56 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:27.517450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-08b63b0f-7f45-4828-bf5e-faccc66a1b56 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:27.524675 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-08b63b0f-7f45-4828-bf5e-faccc66a1b56 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:27.525262 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-08b63b0f-7f45-4828-bf5e-faccc66a1b56 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:27.526248 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-08b63b0f-7f45-4828-bf5e-faccc66a1b56 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:27.526892 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-08b63b0f-7f45-4828-bf5e-faccc66a1b56 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:27.664991 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-08b63b0f-7f45-4828-bf5e-faccc66a1b56 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:27.673207 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-08b63b0f-7f45-4828-bf5e-faccc66a1b56 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.165501 May 13 13:26:27.673799 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 69/157] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:27 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:28.237922 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0b10e3d8-efc9-4cf5-8d96-5b84510045fb tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] Action: 'create', calling method: .version_select at 0x7faaa1f8eb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1017850114", "metadata": {"Type": "work"}}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:28.690642 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a87a2536-586e-4494-b7b8-cdbefe4b0507 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:28.691378 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a87a2536-586e-4494-b7b8-cdbefe4b0507 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:28.698196 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a87a2536-586e-4494-b7b8-cdbefe4b0507 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:28.698753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a87a2536-586e-4494-b7b8-cdbefe4b0507 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:28.699630 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a87a2536-586e-4494-b7b8-cdbefe4b0507 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:28.700593 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a87a2536-586e-4494-b7b8-cdbefe4b0507 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:28.890288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a87a2536-586e-4494-b7b8-cdbefe4b0507 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:28.898072 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a87a2536-586e-4494-b7b8-cdbefe4b0507 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.211184 May 13 13:26:28.901893 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 70/158] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:28 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:29.018524 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0b10e3d8-efc9-4cf5-8d96-5b84510045fb tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.916732 May 13 13:26:29.018524 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 89/159] 10.222.0.25 () {60 vars in 1155 bytes} [Fri May 13 13:26:28 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 918 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 13:26:29.027132 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-118db334-1836-49ca-8c03-454b3b4e971b tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] Calling method '.version_select at 0x7faaa20a28b0>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:29.207216 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-118db334-1836-49ca-8c03-454b3b4e971b tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211" status: 200 len: 353 microversion: 2.1 time: 0.183924 May 13 13:26:29.208002 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 71/160] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:26:29 2022] GET /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 => generated 353 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:26:29.923627 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-19cea50e-c3f1-4292-b997-370ef556b59a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:29.924245 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-19cea50e-c3f1-4292-b997-370ef556b59a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:29.930119 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-19cea50e-c3f1-4292-b997-370ef556b59a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:29.930575 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-19cea50e-c3f1-4292-b997-370ef556b59a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:29.931343 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-19cea50e-c3f1-4292-b997-370ef556b59a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:29.931933 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-19cea50e-c3f1-4292-b997-370ef556b59a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:30.064959 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-19cea50e-c3f1-4292-b997-370ef556b59a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:30.072627 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-19cea50e-c3f1-4292-b997-370ef556b59a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.152796 May 13 13:26:30.073197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 90/161] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:29 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:30.220716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5424e4dc-3437-42ab-82c7-98f3c1e6ef53 tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] Calling method '.version_select at 0x7faaa1fa75e0>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:30.266812 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-5424e4dc-3437-42ab-82c7-98f3c1e6ef53 tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211" status: 200 len: 354 microversion: 2.1 time: 0.050354 May 13 13:26:30.267385 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 72/162] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:26:30 2022] GET /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:30.278532 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f08100fc-c44f-4387-9a76-9dec3c757ecb tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] Calling method '.version_select at 0x7faaa1f8e820>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:30.324814 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f08100fc-c44f-4387-9a76-9dec3c757ecb tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211" status: 200 len: 354 microversion: 2.1 time: 0.049907 May 13 13:26:30.325489 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 91/163] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:26:30 2022] GET /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:30.337445 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d18cf504-98b1-4c03-8fd9-1850464bbd08 tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] Calling method '.version_select at 0x7faaa1fa7a60>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:30.645573 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d18cf504-98b1-4c03-8fd9-1850464bbd08 tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211" status: 202 len: 0 microversion: 2.1 time: 0.311845 May 13 13:26:30.646271 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 73/164] 10.222.0.25 () {58 vars in 1247 bytes} [Fri May 13 13:26:30 2022] DELETE /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:26:30.654935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7a9f3a9b-7fe8-4348-9df3-17b97ad1457d tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] Calling method '.version_select at 0x7faaa1f2e430>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:30.723679 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7a9f3a9b-7fe8-4348-9df3-17b97ad1457d tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211" status: 200 len: 353 microversion: 2.1 time: 0.073170 May 13 13:26:30.727834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 92/165] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:26:30 2022] GET /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:31.090382 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9306638e-b387-489f-a40c-126cad65331e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:31.091226 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-9306638e-b387-489f-a40c-126cad65331e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:31.097168 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9306638e-b387-489f-a40c-126cad65331e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:31.097618 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9306638e-b387-489f-a40c-126cad65331e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:31.098423 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9306638e-b387-489f-a40c-126cad65331e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:31.099008 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9306638e-b387-489f-a40c-126cad65331e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:31.235831 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-9306638e-b387-489f-a40c-126cad65331e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:31.242971 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-9306638e-b387-489f-a40c-126cad65331e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.156956 May 13 13:26:31.243762 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 74/166] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:31 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:31.740072 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-696786ed-63e1-4aa3-9243-48edd15ff367 tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] Calling method '.version_select at 0x7faaa1f2e5e0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:31.770635 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-696786ed-63e1-4aa3-9243-48edd15ff367 tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] HTTP exception thrown: Volume 3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 could not be found. May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-696786ed-63e1-4aa3-9243-48edd15ff367 tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] Request method failure captured: May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 HTTP/1.1 May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflyE43WHdOOUXqp0gpv5p-myoATq9sGyD6qZP-57lzwoaCM-L0OEOOjQyqxLGCxIXNR4uLFGX2NoZVHd3hVd8p41XX3mPkmFdlLpYdzp-sz2lCk1A2mPzg6LDi6FB1domuMZAVZHdQWyBP2mbCz7oJRkAF0Tt6seyeMNVcUEQkTnkj0 May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 124fdd0326d04385b1e8cdfe6704145f May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesGetTestJSON-1882875480 May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:26:31.773707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/124fdd0326d04385b1e8cdfe6704145f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_124fdd0326d04385b1e8cdfe6704145f", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/124fdd0326d04385b1e8cdfe6704145f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/124fdd0326d04385b1e8cdfe6704145f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesGetTestJSON-1882875480 May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 124fdd0326d04385b1e8cdfe6704145f May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesGetTestJSON-1882875480 May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesGetTestJSON-1882875480-project May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 269972d42449433b8a26c1d364ffc071 May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesGetTestJSON-1882875480-project May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Volume 3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 could not be found. May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '3b039bbb-2b7b-48f2-bbdd-8d0b5474f211'} May 13 13:26:31.775124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 could not be found. (HTTP 404) (Request-ID: req-3a8be929-a8a3-417a-8b14-e9711ba14d93) May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:31.775861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:26:31.776943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 could not be found. May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 13:26:31.777970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 could not be found. May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 could not be found. May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-696786ed-63e1-4aa3-9243-48edd15ff367 tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] Returning 404 to user: Volume 3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-696786ed-63e1-4aa3-9243-48edd15ff367 tempest-VolumesGetTestJSON-1882875480 tempest-VolumesGetTestJSON-1882875480-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211" status: 404 len: 109 microversion: 2.1 time: 0.043490 May 13 13:26:31.779313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 93/167] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:26:31 2022] GET /compute/v2.1/os-volumes/3b039bbb-2b7b-48f2-bbdd-8d0b5474f211 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:26:32.260943 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b5f3f455-9d6d-4fd3-aa38-4579aa3f50ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:32.262831 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b5f3f455-9d6d-4fd3-aa38-4579aa3f50ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:32.270822 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b5f3f455-9d6d-4fd3-aa38-4579aa3f50ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:32.271198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b5f3f455-9d6d-4fd3-aa38-4579aa3f50ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:32.272151 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b5f3f455-9d6d-4fd3-aa38-4579aa3f50ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:32.272932 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b5f3f455-9d6d-4fd3-aa38-4579aa3f50ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:32.448391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b5f3f455-9d6d-4fd3-aa38-4579aa3f50ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:32.455595 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b5f3f455-9d6d-4fd3-aa38-4579aa3f50ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.198926 May 13 13:26:32.456177 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 75/168] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:32 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:33.474981 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c90a1a4c-1461-4602-b4b5-28b08b95e7a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:33.475616 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c90a1a4c-1461-4602-b4b5-28b08b95e7a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:33.483887 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c90a1a4c-1461-4602-b4b5-28b08b95e7a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:33.486434 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c90a1a4c-1461-4602-b4b5-28b08b95e7a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:33.486434 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c90a1a4c-1461-4602-b4b5-28b08b95e7a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:33.486434 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c90a1a4c-1461-4602-b4b5-28b08b95e7a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:33.615724 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c90a1a4c-1461-4602-b4b5-28b08b95e7a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:33.623249 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c90a1a4c-1461-4602-b4b5-28b08b95e7a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.154821 May 13 13:26:33.625837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 94/169] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:33 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:34.639438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-517cf82a-0c2c-48e1-b6d1-e2694a15f087 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:34.640080 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-517cf82a-0c2c-48e1-b6d1-e2694a15f087 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:34.646341 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-517cf82a-0c2c-48e1-b6d1-e2694a15f087 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:34.646791 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-517cf82a-0c2c-48e1-b6d1-e2694a15f087 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:34.647567 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-517cf82a-0c2c-48e1-b6d1-e2694a15f087 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:34.648005 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-517cf82a-0c2c-48e1-b6d1-e2694a15f087 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:34.778528 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-517cf82a-0c2c-48e1-b6d1-e2694a15f087 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:34.787953 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-517cf82a-0c2c-48e1-b6d1-e2694a15f087 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.152344 May 13 13:26:34.800170 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 76/170] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:34 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:35.807687 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4b4663b4-5e93-43e2-a5c8-b70fc681e816 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:35.808212 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4b4663b4-5e93-43e2-a5c8-b70fc681e816 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:35.814616 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4b4663b4-5e93-43e2-a5c8-b70fc681e816 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:35.815067 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4b4663b4-5e93-43e2-a5c8-b70fc681e816 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:35.815834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4b4663b4-5e93-43e2-a5c8-b70fc681e816 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:35.816269 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4b4663b4-5e93-43e2-a5c8-b70fc681e816 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:35.948946 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4b4663b4-5e93-43e2-a5c8-b70fc681e816 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:35.956892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4b4663b4-5e93-43e2-a5c8-b70fc681e816 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.153060 May 13 13:26:35.957456 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 95/171] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:35 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:36.973929 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6fee5d55-f6bc-4543-93e2-88b3260be42a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:36.974568 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6fee5d55-f6bc-4543-93e2-88b3260be42a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:36.980852 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6fee5d55-f6bc-4543-93e2-88b3260be42a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:36.981298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6fee5d55-f6bc-4543-93e2-88b3260be42a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:36.982082 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6fee5d55-f6bc-4543-93e2-88b3260be42a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:36.982518 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6fee5d55-f6bc-4543-93e2-88b3260be42a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:37.112529 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6fee5d55-f6bc-4543-93e2-88b3260be42a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:37.120056 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6fee5d55-f6bc-4543-93e2-88b3260be42a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.150027 May 13 13:26:37.120634 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 77/172] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:36 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:38.136997 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-71f72a5c-e6cc-4338-b5e5-48f2b0fb6f30 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:38.137606 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-71f72a5c-e6cc-4338-b5e5-48f2b0fb6f30 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:38.147792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-71f72a5c-e6cc-4338-b5e5-48f2b0fb6f30 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:38.147792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-71f72a5c-e6cc-4338-b5e5-48f2b0fb6f30 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:38.147792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-71f72a5c-e6cc-4338-b5e5-48f2b0fb6f30 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:38.147792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-71f72a5c-e6cc-4338-b5e5-48f2b0fb6f30 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:38.231381 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-cd6463f0-ad45-41b6-911b-af71f12c394a tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] Calling method '.version_select at 0x7faaa1fbca60>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:38.273719 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-71f72a5c-e6cc-4338-b5e5-48f2b0fb6f30 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:38.281551 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-71f72a5c-e6cc-4338-b5e5-48f2b0fb6f30 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.148438 May 13 13:26:38.285858 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 96/173] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:38 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:38.287301 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-cd6463f0-ad45-41b6-911b-af71f12c394a tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/3a2ae4ab-e9b7-4411-b4e6-8ac17095dddf" status: 200 len: 350 microversion: 2.1 time: 0.060120 May 13 13:26:38.288003 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 78/174] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:26:38 2022] GET /compute/v2.1/os-volumes/3a2ae4ab-e9b7-4411-b4e6-8ac17095dddf => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:26:39.298685 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-db002eed-f09f-4fd6-ab69-6d195c9c49f2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:39.299285 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-db002eed-f09f-4fd6-ab69-6d195c9c49f2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:39.312906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-db002eed-f09f-4fd6-ab69-6d195c9c49f2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:39.312906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-db002eed-f09f-4fd6-ab69-6d195c9c49f2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:39.312906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-db002eed-f09f-4fd6-ab69-6d195c9c49f2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:39.312906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-db002eed-f09f-4fd6-ab69-6d195c9c49f2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:39.439159 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-db002eed-f09f-4fd6-ab69-6d195c9c49f2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:39.449559 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-db002eed-f09f-4fd6-ab69-6d195c9c49f2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.154596 May 13 13:26:39.450382 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 97/175] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:39 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:40.072028 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-93ebc307-b709-4d16-8186-4d81a263b789 tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] Calling method '.version_select at 0x7faaa31f6a60>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:40.190676 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-93ebc307-b709-4d16-8186-4d81a263b789 tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/c3f2e124-5a9e-4edb-bccd-24c208566081" status: 200 len: 351 microversion: 2.1 time: 0.122509 May 13 13:26:40.191118 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 79/176] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:26:40 2022] GET /compute/v2.1/os-volumes/c3f2e124-5a9e-4edb-bccd-24c208566081 => generated 351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:40.467480 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-155d3a8b-3ef9-4e34-955e-95b8018fef81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:40.468120 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-155d3a8b-3ef9-4e34-955e-95b8018fef81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:40.474239 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-155d3a8b-3ef9-4e34-955e-95b8018fef81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:40.474692 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-155d3a8b-3ef9-4e34-955e-95b8018fef81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:40.475581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-155d3a8b-3ef9-4e34-955e-95b8018fef81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:40.476024 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-155d3a8b-3ef9-4e34-955e-95b8018fef81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:40.609771 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-155d3a8b-3ef9-4e34-955e-95b8018fef81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:40.617291 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-155d3a8b-3ef9-4e34-955e-95b8018fef81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1520 microversion: 2.1 time: 0.154194 May 13 13:26:40.618082 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 98/177] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:40 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:41.635978 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4771e457-8ddc-415d-a501-ebbf111b9039 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:41.636391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-4771e457-8ddc-415d-a501-ebbf111b9039 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:41.643507 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4771e457-8ddc-415d-a501-ebbf111b9039 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:41.644828 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4771e457-8ddc-415d-a501-ebbf111b9039 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:41.644828 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4771e457-8ddc-415d-a501-ebbf111b9039 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:41.645302 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4771e457-8ddc-415d-a501-ebbf111b9039 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:41.777727 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-4771e457-8ddc-415d-a501-ebbf111b9039 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:41.785130 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4771e457-8ddc-415d-a501-ebbf111b9039 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1500 microversion: 2.1 time: 0.154346 May 13 13:26:41.785699 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 80/178] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:41 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:41.801512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e74daf55-58ef-4f24-9da9-97e039fb9cad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:41.802152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e74daf55-58ef-4f24-9da9-97e039fb9cad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:41.808087 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e74daf55-58ef-4f24-9da9-97e039fb9cad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:41.808570 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e74daf55-58ef-4f24-9da9-97e039fb9cad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:41.809385 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e74daf55-58ef-4f24-9da9-97e039fb9cad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:41.809841 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e74daf55-58ef-4f24-9da9-97e039fb9cad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:41.944212 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e74daf55-58ef-4f24-9da9-97e039fb9cad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:41.955212 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e74daf55-58ef-4f24-9da9-97e039fb9cad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1515 microversion: 2.1 time: 0.157416 May 13 13:26:41.956683 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 99/179] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:41 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:42.005388 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-49b79953-2fac-4066-85b4-55d3a4da7304 tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] Calling method '.version_select at 0x7faaa20a2dc0>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:42.053818 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-49b79953-2fac-4066-85b4-55d3a4da7304 tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/265a9065-f67a-4a2e-be59-e210c89ab0ac" status: 200 len: 350 microversion: 2.1 time: 0.052373 May 13 13:26:42.054411 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 81/180] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:26:42 2022] GET /compute/v2.1/os-volumes/265a9065-f67a-4a2e-be59-e210c89ab0ac => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:42.066384 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cee13b46-fb1c-4291-b268-be211c6375a8 tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] Calling method '.version_select at 0x7faaa1f41af0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:42.150513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cee13b46-fb1c-4291-b268-be211c6375a8 tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.088062 May 13 13:26:42.151086 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 100/181] 10.222.0.25 () {58 vars in 1133 bytes} [Fri May 13 13:26:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:42.162899 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4468a852-6884-42a2-acc1-cb262157c3eb tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] Calling method '.version_select at 0x7faaa1fbcca0>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:42.242455 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4468a852-6884-42a2-acc1-cb262157c3eb tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083191 May 13 13:26:42.243179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 82/182] 10.222.0.25 () {58 vars in 1148 bytes} [Fri May 13 13:26:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:42.255592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2a6fb75a-3651-4e84-beff-80a2e97ab0fb tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] Calling method '.version_select at 0x7faaa1f8ea60>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:42.335952 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2a6fb75a-3651-4e84-beff-80a2e97ab0fb tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.083730 May 13 13:26:42.336556 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 101/183] 10.222.0.25 () {58 vars in 1133 bytes} [Fri May 13 13:26:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:42.347746 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8ffda10d-2203-48e6-a085-ca5f510719d2 tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] Calling method '.version_select at 0x7faaa1fbc3a0>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:42.427321 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8ffda10d-2203-48e6-a085-ca5f510719d2 tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083362 May 13 13:26:42.427892 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 83/184] 10.222.0.25 () {58 vars in 1166 bytes} [Fri May 13 13:26:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:42.440313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bfd9aecf-5fdc-4671-a1bc-7a98d8663bca tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] Calling method '.version_select at 0x7faaa1f2e3a0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:42.525674 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bfd9aecf-5fdc-4671-a1bc-7a98d8663bca tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088931 May 13 13:26:42.526325 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 102/185] 10.222.0.25 () {58 vars in 1169 bytes} [Fri May 13 13:26:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:42.539293 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c396456b-3d52-4c50-8aed-626d9c63f1ca tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] Calling method '.version_select at 0x7faaa1fa70d0>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:42.732572 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c396456b-3d52-4c50-8aed-626d9c63f1ca tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083044 May 13 13:26:42.732572 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 84/186] 10.222.0.25 () {58 vars in 1154 bytes} [Fri May 13 13:26:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:42.741210 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-de6c281e-3a74-4f41-9b44-e4c8d6561580 tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] Calling method '.version_select at 0x7faaa2a16d30>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:42.839550 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-de6c281e-3a74-4f41-9b44-e4c8d6561580 tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.097954 May 13 13:26:42.839550 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 103/187] 10.222.0.25 () {58 vars in 1187 bytes} [Fri May 13 13:26:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:42.848451 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d2bd9628-3a26-41d9-935d-ccf8cb9e56e9 tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] Calling method '.version_select at 0x7faaa323f670>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:42.926940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d2bd9628-3a26-41d9-935d-ccf8cb9e56e9 tempest-VolumesTestJSON-838129266 tempest-VolumesTestJSON-838129266-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.082618 May 13 13:26:42.927502 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 85/188] 10.222.0.25 () {58 vars in 1154 bytes} [Fri May 13 13:26:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:44.257768 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ae4b015e-67fa-4039-b434-9938a2028205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:44.259050 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ae4b015e-67fa-4039-b434-9938a2028205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:44.265172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ae4b015e-67fa-4039-b434-9938a2028205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:44.266136 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ae4b015e-67fa-4039-b434-9938a2028205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:44.272356 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ae4b015e-67fa-4039-b434-9938a2028205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:44.273018 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ae4b015e-67fa-4039-b434-9938a2028205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:44.303686 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-ae4b015e-67fa-4039-b434-9938a2028205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lazy-loading 'flavor' on Instance uuid a1f73c3e-c6fc-443b-a892-bf21c184de0c {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:26:44.621461 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ae4b015e-67fa-4039-b434-9938a2028205 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "POST /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c/action" status: 200 len: 32 microversion: 2.1 time: 0.367569 May 13 13:26:44.622111 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 104/189] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:26:44 2022] POST /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:26:44.632226 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-fc59ad33-874e-4f56-b647-ec674018ed16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:44.633767 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-fc59ad33-874e-4f56-b647-ec674018ed16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:44.641744 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fc59ad33-874e-4f56-b647-ec674018ed16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:44.642232 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fc59ad33-874e-4f56-b647-ec674018ed16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:44.643034 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fc59ad33-874e-4f56-b647-ec674018ed16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:44.643898 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fc59ad33-874e-4f56-b647-ec674018ed16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:44.821594 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-fc59ad33-874e-4f56-b647-ec674018ed16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:44.830323 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-fc59ad33-874e-4f56-b647-ec674018ed16 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.202643 May 13 13:26:44.840067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 86/190] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:44 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:45.848105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-56cffd34-3faf-41d0-bc9f-8333f7a6e95d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:45.848760 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-56cffd34-3faf-41d0-bc9f-8333f7a6e95d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:45.857372 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56cffd34-3faf-41d0-bc9f-8333f7a6e95d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:45.858053 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56cffd34-3faf-41d0-bc9f-8333f7a6e95d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:45.859768 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56cffd34-3faf-41d0-bc9f-8333f7a6e95d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:45.860367 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56cffd34-3faf-41d0-bc9f-8333f7a6e95d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:46.006925 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-56cffd34-3faf-41d0-bc9f-8333f7a6e95d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:46.014400 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-56cffd34-3faf-41d0-bc9f-8333f7a6e95d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.171540 May 13 13:26:46.014977 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 105/191] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:45 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:47.031880 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6a659546-68d7-4038-b1e5-d10948be4f5f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:47.032488 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6a659546-68d7-4038-b1e5-d10948be4f5f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:47.038830 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6a659546-68d7-4038-b1e5-d10948be4f5f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:47.039277 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6a659546-68d7-4038-b1e5-d10948be4f5f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:47.040041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6a659546-68d7-4038-b1e5-d10948be4f5f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:47.040489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6a659546-68d7-4038-b1e5-d10948be4f5f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:47.176133 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6a659546-68d7-4038-b1e5-d10948be4f5f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:47.183852 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6a659546-68d7-4038-b1e5-d10948be4f5f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.155980 May 13 13:26:47.184854 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 87/192] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:47 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:48.201999 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-82b41030-e4ef-4888-b174-7d2bdcdbfa81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:48.202685 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-82b41030-e4ef-4888-b174-7d2bdcdbfa81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:48.209185 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-82b41030-e4ef-4888-b174-7d2bdcdbfa81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:48.209565 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-82b41030-e4ef-4888-b174-7d2bdcdbfa81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:48.210354 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-82b41030-e4ef-4888-b174-7d2bdcdbfa81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:48.211015 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-82b41030-e4ef-4888-b174-7d2bdcdbfa81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:48.356923 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-82b41030-e4ef-4888-b174-7d2bdcdbfa81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:48.365048 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-82b41030-e4ef-4888-b174-7d2bdcdbfa81 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.168150 May 13 13:26:48.365864 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 106/193] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:48 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:49.382230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c9ae880f-9520-4022-8b37-613c9769a69c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:49.385878 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c9ae880f-9520-4022-8b37-613c9769a69c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:49.389806 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c9ae880f-9520-4022-8b37-613c9769a69c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:49.390290 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c9ae880f-9520-4022-8b37-613c9769a69c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:49.391256 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c9ae880f-9520-4022-8b37-613c9769a69c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:49.391845 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c9ae880f-9520-4022-8b37-613c9769a69c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:49.530174 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c9ae880f-9520-4022-8b37-613c9769a69c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:49.537640 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c9ae880f-9520-4022-8b37-613c9769a69c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.159254 May 13 13:26:49.538222 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 88/194] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:49 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:49.763234 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1685856781", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "networks": [{"uuid": "4811dfd5-b4ea-4a2f-a60d-8cbf48f0d4e7"}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:49.815120 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] validate_networks() for [('4811dfd5-b4ea-4a2f-a60d-8cbf48f0d4e7', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:26:50.176332 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:26:50.176332 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:26:50.176332 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:26:50.176332 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:26:50.177019 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:26:50.186159 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:50.186819 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:50.187816 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:50.188121 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:50.206983 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Getting quotas for project 3ea1460c53954c6a915fc638a2690cbf. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:26:50.212125 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Getting quotas for user 1cdee89f8a8040ca944458d3fc6f18eb and project 3ea1460c53954c6a915fc638a2690cbf. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:26:50.223642 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:26:50.225909 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:26:50.354779 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2d8d9338-bcb7-4d2f-bb70-64863f9fad89 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595298 May 13 13:26:50.356020 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 107/195] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:26:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:26:50.365884 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d65a5265-7ef7-4173-8f3e-8d5656c62fdd tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:50.366588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d65a5265-7ef7-4173-8f3e-8d5656c62fdd tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:50.463632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d65a5265-7ef7-4173-8f3e-8d5656c62fdd tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:50.471882 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d65a5265-7ef7-4173-8f3e-8d5656c62fdd tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1214 microversion: 2.1 time: 0.109948 May 13 13:26:50.479441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 89/196] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:50 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:50.554867 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b9fd5d63-15a5-4d4f-b053-4ac66ced86ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:50.555660 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b9fd5d63-15a5-4d4f-b053-4ac66ced86ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:50.562844 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9fd5d63-15a5-4d4f-b053-4ac66ced86ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:50.564000 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9fd5d63-15a5-4d4f-b053-4ac66ced86ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:50.566648 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9fd5d63-15a5-4d4f-b053-4ac66ced86ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:50.567132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9fd5d63-15a5-4d4f-b053-4ac66ced86ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:50.738866 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b9fd5d63-15a5-4d4f-b053-4ac66ced86ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:50.749441 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b9fd5d63-15a5-4d4f-b053-4ac66ced86ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.198369 May 13 13:26:50.750304 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 108/197] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:50 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:51.507985 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0e75265e-5e0f-4cb3-ae62-fabdc5f8ae87 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:51.509042 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0e75265e-5e0f-4cb3-ae62-fabdc5f8ae87 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:51.567117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0e75265e-5e0f-4cb3-ae62-fabdc5f8ae87 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:51.574574 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0e75265e-5e0f-4cb3-ae62-fabdc5f8ae87 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1214 microversion: 2.1 time: 0.081641 May 13 13:26:51.575730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 90/198] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:51 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:51.767630 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2b27e89e-dfdf-451b-83a3-ba799fa6394a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:51.768242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2b27e89e-dfdf-451b-83a3-ba799fa6394a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:51.774457 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2b27e89e-dfdf-451b-83a3-ba799fa6394a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:51.774908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2b27e89e-dfdf-451b-83a3-ba799fa6394a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:51.775682 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2b27e89e-dfdf-451b-83a3-ba799fa6394a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:51.776114 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2b27e89e-dfdf-451b-83a3-ba799fa6394a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:51.952775 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2b27e89e-dfdf-451b-83a3-ba799fa6394a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:51.961182 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2b27e89e-dfdf-451b-83a3-ba799fa6394a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.197441 May 13 13:26:51.971734 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 109/199] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:51 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:52.592209 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7808e060-8c14-49e8-9115-4aff45b1f993 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:52.592917 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7808e060-8c14-49e8-9115-4aff45b1f993 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:52.599325 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7808e060-8c14-49e8-9115-4aff45b1f993 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:52.599779 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7808e060-8c14-49e8-9115-4aff45b1f993 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:52.600555 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7808e060-8c14-49e8-9115-4aff45b1f993 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:52.600995 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7808e060-8c14-49e8-9115-4aff45b1f993 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:52.664062 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-7808e060-8c14-49e8-9115-4aff45b1f993 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:52.671955 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7808e060-8c14-49e8-9115-4aff45b1f993 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1266 microversion: 2.1 time: 0.083665 May 13 13:26:52.679867 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 91/200] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:52 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:52.978651 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-560ac537-a697-47ee-95c7-1d9acdc6c13d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:52.979294 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-560ac537-a697-47ee-95c7-1d9acdc6c13d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:52.985187 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-560ac537-a697-47ee-95c7-1d9acdc6c13d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:52.985640 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-560ac537-a697-47ee-95c7-1d9acdc6c13d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:52.986442 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-560ac537-a697-47ee-95c7-1d9acdc6c13d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:52.986930 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-560ac537-a697-47ee-95c7-1d9acdc6c13d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:53.121348 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-560ac537-a697-47ee-95c7-1d9acdc6c13d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:53.129075 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-560ac537-a697-47ee-95c7-1d9acdc6c13d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.154266 May 13 13:26:53.129682 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 110/201] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:52 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:53.693287 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-35027df8-0dcb-4431-aae9-8bc36b4b90b9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:53.694725 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-35027df8-0dcb-4431-aae9-8bc36b4b90b9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:53.702319 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-35027df8-0dcb-4431-aae9-8bc36b4b90b9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:53.702801 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-35027df8-0dcb-4431-aae9-8bc36b4b90b9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:53.703582 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-35027df8-0dcb-4431-aae9-8bc36b4b90b9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:53.704032 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-35027df8-0dcb-4431-aae9-8bc36b4b90b9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:53.891361 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-914494d6-0258-48fe-b12b-89c67dc30a85 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:53.892022 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-914494d6-0258-48fe-b12b-89c67dc30a85 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:53.903735 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-914494d6-0258-48fe-b12b-89c67dc30a85 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:53.903735 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-914494d6-0258-48fe-b12b-89c67dc30a85 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:53.904742 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-914494d6-0258-48fe-b12b-89c67dc30a85 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:53.905388 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-914494d6-0258-48fe-b12b-89c67dc30a85 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:53.927148 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-35027df8-0dcb-4431-aae9-8bc36b4b90b9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:53.937818 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-35027df8-0dcb-4431-aae9-8bc36b4b90b9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1284 microversion: 2.1 time: 0.250855 May 13 13:26:53.938697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 92/202] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:53 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:53.954526 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-914494d6-0258-48fe-b12b-89c67dc30a85 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/ips" status: 200 len: 145 microversion: 2.1 time: 0.067687 May 13 13:26:53.957977 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 111/203] 10.222.0.25 () {58 vars in 1247 bytes} [Fri May 13 13:26:53 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/ips => generated 145 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:26:54.147260 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b7e8d022-1589-4cb8-8d09-f96ac15b73d0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:54.149345 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b7e8d022-1589-4cb8-8d09-f96ac15b73d0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:54.155968 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b7e8d022-1589-4cb8-8d09-f96ac15b73d0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:54.156487 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b7e8d022-1589-4cb8-8d09-f96ac15b73d0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:54.157610 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b7e8d022-1589-4cb8-8d09-f96ac15b73d0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:54.158509 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b7e8d022-1589-4cb8-8d09-f96ac15b73d0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:54.300864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b7e8d022-1589-4cb8-8d09-f96ac15b73d0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:54.310584 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b7e8d022-1589-4cb8-8d09-f96ac15b73d0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.167598 May 13 13:26:54.311405 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 93/204] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:54 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:54.955044 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ce67106b-4b66-48db-a3af-b66352a6f8fb tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:54.955824 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ce67106b-4b66-48db-a3af-b66352a6f8fb tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:54.962024 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce67106b-4b66-48db-a3af-b66352a6f8fb tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:54.962554 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce67106b-4b66-48db-a3af-b66352a6f8fb tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:54.963333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce67106b-4b66-48db-a3af-b66352a6f8fb tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:54.963761 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce67106b-4b66-48db-a3af-b66352a6f8fb tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:55.328757 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-828beff7-d84e-42cd-9cd5-ed4a8e345528 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:55.329462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-828beff7-d84e-42cd-9cd5-ed4a8e345528 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:55.343187 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-828beff7-d84e-42cd-9cd5-ed4a8e345528 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:55.343187 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-828beff7-d84e-42cd-9cd5-ed4a8e345528 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:55.343187 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-828beff7-d84e-42cd-9cd5-ed4a8e345528 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:55.343187 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-828beff7-d84e-42cd-9cd5-ed4a8e345528 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:55.343721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ce67106b-4b66-48db-a3af-b66352a6f8fb tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:55.352126 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ce67106b-4b66-48db-a3af-b66352a6f8fb tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1314 microversion: 2.1 time: 0.400707 May 13 13:26:55.353149 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 112/205] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:54 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:55.525499 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-828beff7-d84e-42cd-9cd5-ed4a8e345528 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:55.536443 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-828beff7-d84e-42cd-9cd5-ed4a8e345528 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.209249 May 13 13:26:55.547302 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 94/206] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:55 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:55.850266 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-88157379-2e66-4030-94dc-7ed607e209b6 req-c5ee83ad-e842-475e-88b3-f9489647c65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ebf9462-f8b5-4711-b5cf-0a8be1c9e529", "tag": "c3b1b4a5-4ef8-40ce-91a1-82b1cdfb9e5f"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:55.858897 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-88157379-2e66-4030-94dc-7ed607e209b6 req-c5ee83ad-e842-475e-88b3-f9489647c65c service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:55.859275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-88157379-2e66-4030-94dc-7ed607e209b6 req-c5ee83ad-e842-475e-88b3-f9489647c65c service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:55.870168 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-88157379-2e66-4030-94dc-7ed607e209b6 req-c5ee83ad-e842-475e-88b3-f9489647c65c service nova] Creating event network-changed:c3b1b4a5-4ef8-40ce-91a1-82b1cdfb9e5f for instance 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 on hv-cinder-84159 May 13 13:26:55.875497 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-88157379-2e66-4030-94dc-7ed607e209b6 req-c5ee83ad-e842-475e-88b3-f9489647c65c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029153 May 13 13:26:55.876082 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 113/207] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:26:56.369591 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1b105a4e-5ced-4537-b165-fab0d76b5738 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:56.370102 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1b105a4e-5ced-4537-b165-fab0d76b5738 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:56.376757 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1b105a4e-5ced-4537-b165-fab0d76b5738 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:56.377280 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1b105a4e-5ced-4537-b165-fab0d76b5738 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:56.378038 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1b105a4e-5ced-4537-b165-fab0d76b5738 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:56.378482 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1b105a4e-5ced-4537-b165-fab0d76b5738 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:56.536345 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1b105a4e-5ced-4537-b165-fab0d76b5738 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:56.544092 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1b105a4e-5ced-4537-b165-fab0d76b5738 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1314 microversion: 2.1 time: 0.178686 May 13 13:26:56.554187 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 95/208] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:56 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:56.560264 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e791e609-a8f4-4afc-b179-1d176567bc9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:56.561650 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e791e609-a8f4-4afc-b179-1d176567bc9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:56.570165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e791e609-a8f4-4afc-b179-1d176567bc9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:56.570790 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e791e609-a8f4-4afc-b179-1d176567bc9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:56.572047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e791e609-a8f4-4afc-b179-1d176567bc9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:56.573279 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e791e609-a8f4-4afc-b179-1d176567bc9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:56.730284 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e791e609-a8f4-4afc-b179-1d176567bc9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:56.739920 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e791e609-a8f4-4afc-b179-1d176567bc9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.184932 May 13 13:26:56.742160 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 114/209] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:56 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:57.560816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c021a33a-c4da-42c4-8bf8-64d74eb3800c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:57.561383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c021a33a-c4da-42c4-8bf8-64d74eb3800c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:57.568681 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c021a33a-c4da-42c4-8bf8-64d74eb3800c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:57.569171 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c021a33a-c4da-42c4-8bf8-64d74eb3800c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:57.570171 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c021a33a-c4da-42c4-8bf8-64d74eb3800c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:57.570974 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c021a33a-c4da-42c4-8bf8-64d74eb3800c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:57.735750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c021a33a-c4da-42c4-8bf8-64d74eb3800c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:57.747876 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c021a33a-c4da-42c4-8bf8-64d74eb3800c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1314 microversion: 2.1 time: 0.190256 May 13 13:26:57.748461 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 96/210] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:57 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:57.766460 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b5b4f781-9b88-4a8a-8c13-9dae5b8af2e5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:57.767975 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b5b4f781-9b88-4a8a-8c13-9dae5b8af2e5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:57.774464 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5b4f781-9b88-4a8a-8c13-9dae5b8af2e5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:57.774911 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5b4f781-9b88-4a8a-8c13-9dae5b8af2e5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:57.775730 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5b4f781-9b88-4a8a-8c13-9dae5b8af2e5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:57.776160 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5b4f781-9b88-4a8a-8c13-9dae5b8af2e5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:57.925661 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b5b4f781-9b88-4a8a-8c13-9dae5b8af2e5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:57.932983 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b5b4f781-9b88-4a8a-8c13-9dae5b8af2e5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.173477 May 13 13:26:57.935935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 115/211] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:57 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:58.344023 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6e8a9c11-8200-4987-a44a-61cf905f0ff8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59198fe1-c6dd-4af9-a2b0-277418cb79a4"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:26:58.345168 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6e8a9c11-8200-4987-a44a-61cf905f0ff8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:58.351318 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6e8a9c11-8200-4987-a44a-61cf905f0ff8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:58.351783 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6e8a9c11-8200-4987-a44a-61cf905f0ff8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:58.352560 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6e8a9c11-8200-4987-a44a-61cf905f0ff8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:58.353039 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6e8a9c11-8200-4987-a44a-61cf905f0ff8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:58.765764 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9d8471a4-8366-46fb-9fa1-d4226fe882af tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:58.766557 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9d8471a4-8366-46fb-9fa1-d4226fe882af tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:58.773097 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d8471a4-8366-46fb-9fa1-d4226fe882af tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:58.773934 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d8471a4-8366-46fb-9fa1-d4226fe882af tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:58.774796 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d8471a4-8366-46fb-9fa1-d4226fe882af tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:58.775311 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d8471a4-8366-46fb-9fa1-d4226fe882af tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:58.987528 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9d8471a4-8366-46fb-9fa1-d4226fe882af tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:58.995079 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9d8471a4-8366-46fb-9fa1-d4226fe882af tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1314 microversion: 2.1 time: 0.234106 May 13 13:26:58.995779 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 116/212] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:58 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:26:59.000904 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cc8c26e1-d376-495b-8bd3-bce8cdfe6ae7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:59.001519 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cc8c26e1-d376-495b-8bd3-bce8cdfe6ae7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:59.007275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cc8c26e1-d376-495b-8bd3-bce8cdfe6ae7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:59.007735 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cc8c26e1-d376-495b-8bd3-bce8cdfe6ae7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:59.008512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cc8c26e1-d376-495b-8bd3-bce8cdfe6ae7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:59.008956 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cc8c26e1-d376-495b-8bd3-bce8cdfe6ae7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:59.143443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cc8c26e1-d376-495b-8bd3-bce8cdfe6ae7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:26:59.151282 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cc8c26e1-d376-495b-8bd3-bce8cdfe6ae7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.153983 May 13 13:26:59.152086 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 117/213] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:26:58 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:26:59.270738 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4b302e1a-b355-4187-baab-c3c9f7fc6df0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:26:59.273159 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4b302e1a-b355-4187-baab-c3c9f7fc6df0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:26:59.281797 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4b302e1a-b355-4187-baab-c3c9f7fc6df0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:59.282257 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4b302e1a-b355-4187-baab-c3c9f7fc6df0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:59.283020 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4b302e1a-b355-4187-baab-c3c9f7fc6df0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:26:59.283450 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4b302e1a-b355-4187-baab-c3c9f7fc6df0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:26:59.308229 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4b302e1a-b355-4187-baab-c3c9f7fc6df0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/ips" status: 200 len: 152 microversion: 2.20 time: 0.041301 May 13 13:26:59.308821 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 118/214] 10.222.0.25 () {60 vars in 1288 bytes} [Fri May 13 13:26:59 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:27:00.012414 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-51558229-cc9a-4307-bbad-84cc36b3a62f tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:00.013030 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-51558229-cc9a-4307-bbad-84cc36b3a62f tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:00.019735 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-51558229-cc9a-4307-bbad-84cc36b3a62f tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.020182 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-51558229-cc9a-4307-bbad-84cc36b3a62f tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.020983 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-51558229-cc9a-4307-bbad-84cc36b3a62f tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.021416 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-51558229-cc9a-4307-bbad-84cc36b3a62f tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.229658 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-51558229-cc9a-4307-bbad-84cc36b3a62f tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:00.238257 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-51558229-cc9a-4307-bbad-84cc36b3a62f tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1314 microversion: 2.1 time: 0.230158 May 13 13:27:00.240385 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 119/215] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:00 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:00.246527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9d31ef94-2ed5-4ade-b85f-f77bcd1f2cd0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:00.246527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9d31ef94-2ed5-4ade-b85f-f77bcd1f2cd0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:00.261062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d31ef94-2ed5-4ade-b85f-f77bcd1f2cd0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.261824 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d31ef94-2ed5-4ade-b85f-f77bcd1f2cd0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.262773 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d31ef94-2ed5-4ade-b85f-f77bcd1f2cd0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.263358 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d31ef94-2ed5-4ade-b85f-f77bcd1f2cd0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.415228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9d31ef94-2ed5-4ade-b85f-f77bcd1f2cd0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:00.431595 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9d31ef94-2ed5-4ade-b85f-f77bcd1f2cd0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1501 microversion: 2.1 time: 0.190153 May 13 13:27:00.432239 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 120/216] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:00 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1501 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:00.454432 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b7b74586-e0da-45c9-83f6-9813fe25cb6b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4251fcbd-4916-4fba-8b02-65898c8aecb9"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:00.454796 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b7b74586-e0da-45c9-83f6-9813fe25cb6b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:00.461810 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7b74586-e0da-45c9-83f6-9813fe25cb6b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.462539 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7b74586-e0da-45c9-83f6-9813fe25cb6b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.463513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7b74586-e0da-45c9-83f6-9813fe25cb6b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.464413 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7b74586-e0da-45c9-83f6-9813fe25cb6b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.492917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-b7b74586-e0da-45c9-83f6-9813fe25cb6b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] HTTP exception thrown: Cannot 'attach_volume' instance a1f73c3e-c6fc-443b-a892-bf21c184de0c while it is in vm_state rescued May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b7b74586-e0da-45c9-83f6-9813fe25cb6b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Request method failure captured: May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: POST /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c/os-volume_attachments HTTP/1.1 May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 74 May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflxCd_EoZAFYbTN-djoZynqAsA3N46ltWXN6ElWTHOeJzEEmWdor9xpEb-TN-9UOIjpjSWAAhgMGge4_A1Ww39JKwMQCj0YClHxuL6gKubHiyHfreieaD5jWE6gpoVXXhVTxV1jR6o9ep4G9hWBPrRMtkJorZmtfTBTb1K8oDMtHNwA May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: e25902914d244bfeaa038f24838c28ca May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:27:00.494675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:27:00.495892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e25902914d244bfeaa038f24838c28ca", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:27:00.495892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:27:00.495892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: e25902914d244bfeaa038f24838c28ca May 13 13:27:00.495892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:27:00.495892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-ServerRescueNegativeTestJSON-1596782097-project May 13 13:27:00.495892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:27:00.495892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:27:00.495892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: f56c908ada31445e85ec1dfee8e2ebdb May 13 13:27:00.495892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1596782097-project May 13 13:27:00.495892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: May 13 13:27:00.495892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {"volumeAttachment": {"volumeId": "4251fcbd-4916-4fba-8b02-65898c8aecb9"}} May 13 13:27:00.495892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Cannot 'attach_volume' instance a1f73c3e-c6fc-443b-a892-bf21c184de0c while it is in vm_state rescued May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'server_id': 'a1f73c3e-c6fc-443b-a892-bf21c184de0c', 'body': {'volumeAttachment': {'volumeId': '4251fcbd-4916-4fba-8b02-65898c8aecb9'}}} May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a1f73c3e-c6fc-443b-a892-bf21c184de0c in vm_state rescued. Cannot attach_volume while the instance is in this state. May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:27:00.496592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a1f73c3e-c6fc-443b-a892-bf21c184de0c while it is in vm_state rescued May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:00.497857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:00.499066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:27:00.499066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:27:00.499066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a1f73c3e-c6fc-443b-a892-bf21c184de0c while it is in vm_state rescued May 13 13:27:00.499066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:00.499066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b7b74586-e0da-45c9-83f6-9813fe25cb6b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Returning 409 to user: Cannot 'attach_volume' instance a1f73c3e-c6fc-443b-a892-bf21c184de0c while it is in vm_state rescued {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:27:00.499066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b7b74586-e0da-45c9-83f6-9813fe25cb6b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "POST /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051689 May 13 13:27:00.499066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 121/217] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:27:00 2022] POST /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 13:27:00.506754 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3716d0d7-4836-49a7-a37c-fe3e8346619e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:00.509214 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3716d0d7-4836-49a7-a37c-fe3e8346619e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:00.513263 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3716d0d7-4836-49a7-a37c-fe3e8346619e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.513704 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3716d0d7-4836-49a7-a37c-fe3e8346619e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.514527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3716d0d7-4836-49a7-a37c-fe3e8346619e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.514956 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3716d0d7-4836-49a7-a37c-fe3e8346619e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.810855 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3716d0d7-4836-49a7-a37c-fe3e8346619e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "POST /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c/action" status: 202 len: 0 microversion: 2.1 time: 0.307526 May 13 13:27:00.814391 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 122/218] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:27:00 2022] POST /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:27:00.828807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6e8a9c11-8200-4987-a44a-61cf905f0ff8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "POST /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.488297 May 13 13:27:00.830434 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 97/219] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:26:58 2022] POST /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/os-volume_attachments => generated 194 bytes in 2491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:27:00.859722 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3e534465-ca86-49c8-a40f-66662691f61e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:00.860465 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3e534465-ca86-49c8-a40f-66662691f61e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:00.872643 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3e534465-ca86-49c8-a40f-66662691f61e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.873099 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3e534465-ca86-49c8-a40f-66662691f61e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:00.873917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3e534465-ca86-49c8-a40f-66662691f61e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:00.875757 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3e534465-ca86-49c8-a40f-66662691f61e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:01.151370 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3e534465-ca86-49c8-a40f-66662691f61e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:01.160399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3e534465-ca86-49c8-a40f-66662691f61e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1509 microversion: 2.1 time: 0.330138 May 13 13:27:01.164649 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 123/220] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:00 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1509 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:01.264730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e37cf9e0-62d5-422a-9fa4-ef5716d4584d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:01.265296 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e37cf9e0-62d5-422a-9fa4-ef5716d4584d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:01.275528 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e37cf9e0-62d5-422a-9fa4-ef5716d4584d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:01.275990 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e37cf9e0-62d5-422a-9fa4-ef5716d4584d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:01.276793 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e37cf9e0-62d5-422a-9fa4-ef5716d4584d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:01.277235 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e37cf9e0-62d5-422a-9fa4-ef5716d4584d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:01.448737 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e37cf9e0-62d5-422a-9fa4-ef5716d4584d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:01.456313 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e37cf9e0-62d5-422a-9fa4-ef5716d4584d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1314 microversion: 2.1 time: 0.197721 May 13 13:27:01.457087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 98/221] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:01 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:02.180672 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0f8b43e8-473c-485b-a2f5-f12af7bd22c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:02.181320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0f8b43e8-473c-485b-a2f5-f12af7bd22c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:02.188371 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0f8b43e8-473c-485b-a2f5-f12af7bd22c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:02.188830 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0f8b43e8-473c-485b-a2f5-f12af7bd22c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:02.189609 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0f8b43e8-473c-485b-a2f5-f12af7bd22c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:02.190175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0f8b43e8-473c-485b-a2f5-f12af7bd22c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:02.190378 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-77d1b60a-8862-44b4-a875-a18bdb30e939 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:02.191476 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-77d1b60a-8862-44b4-a875-a18bdb30e939 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:02.198806 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-77d1b60a-8862-44b4-a875-a18bdb30e939 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:02.199264 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-77d1b60a-8862-44b4-a875-a18bdb30e939 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:02.200099 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-77d1b60a-8862-44b4-a875-a18bdb30e939 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:02.200834 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-77d1b60a-8862-44b4-a875-a18bdb30e939 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:02.225488 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-77d1b60a-8862-44b4-a875-a18bdb30e939 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lazy-loading 'flavor' on Instance uuid 89412841-b653-4a80-8cde-0c7a264a9c4c {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:27:02.391009 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0f8b43e8-473c-485b-a2f5-f12af7bd22c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:02.398581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0f8b43e8-473c-485b-a2f5-f12af7bd22c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1509 microversion: 2.1 time: 0.221810 May 13 13:27:02.399682 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 124/222] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:02 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:02.473494 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-40b628ac-d823-465d-ba58-9c3f18051a9d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:02.474241 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-40b628ac-d823-465d-ba58-9c3f18051a9d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:02.484239 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-40b628ac-d823-465d-ba58-9c3f18051a9d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:02.486196 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-40b628ac-d823-465d-ba58-9c3f18051a9d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:02.487158 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-40b628ac-d823-465d-ba58-9c3f18051a9d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:02.487830 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-40b628ac-d823-465d-ba58-9c3f18051a9d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:02.655369 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-40b628ac-d823-465d-ba58-9c3f18051a9d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:02.663309 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-40b628ac-d823-465d-ba58-9c3f18051a9d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1314 microversion: 2.1 time: 0.193625 May 13 13:27:02.664039 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 125/223] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:02 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:02.796606 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-39d1646b-d150-4a3b-a26e-751cc2b84cb5 req-402b51bf-01e7-40da-8ad8-b0983b57f598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebf9462-f8b5-4711-b5cf-0a8be1c9e529", "name": "network-vif-plugged", "status": "completed", "tag": "c3b1b4a5-4ef8-40ce-91a1-82b1cdfb9e5f"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:02.809129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-39d1646b-d150-4a3b-a26e-751cc2b84cb5 req-402b51bf-01e7-40da-8ad8-b0983b57f598 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:02.809621 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-39d1646b-d150-4a3b-a26e-751cc2b84cb5 req-402b51bf-01e7-40da-8ad8-b0983b57f598 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:02.825283 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-39d1646b-d150-4a3b-a26e-751cc2b84cb5 req-402b51bf-01e7-40da-8ad8-b0983b57f598 service nova] Creating event network-vif-plugged:c3b1b4a5-4ef8-40ce-91a1-82b1cdfb9e5f for instance 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 on hv-cinder-84159 May 13 13:27:02.834285 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-39d1646b-d150-4a3b-a26e-751cc2b84cb5 req-402b51bf-01e7-40da-8ad8-b0983b57f598 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043916 May 13 13:27:02.835151 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 126/224] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:27:03.091152 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-77d1b60a-8862-44b4-a875-a18bdb30e939 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "POST /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/action" status: 202 len: 0 microversion: 2.20 time: 0.905349 May 13 13:27:03.091789 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 99/225] 10.222.0.25 () {62 vars in 1318 bytes} [Fri May 13 13:27:02 2022] POST /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/action => generated 0 bytes in 907 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 13 13:27:03.100996 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-116d1dfd-d61b-4305-8698-4c54ab5e4e72 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:03.101693 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-116d1dfd-d61b-4305-8698-4c54ab5e4e72 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:03.107850 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-116d1dfd-d61b-4305-8698-4c54ab5e4e72 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:03.108302 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-116d1dfd-d61b-4305-8698-4c54ab5e4e72 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:03.109066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-116d1dfd-d61b-4305-8698-4c54ab5e4e72 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:03.109502 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-116d1dfd-d61b-4305-8698-4c54ab5e4e72 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:03.247102 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-116d1dfd-d61b-4305-8698-4c54ab5e4e72 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:03.259614 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-116d1dfd-d61b-4305-8698-4c54ab5e4e72 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:03.261180 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-116d1dfd-d61b-4305-8698-4c54ab5e4e72 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:03.262381 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-116d1dfd-d61b-4305-8698-4c54ab5e4e72 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.165594 May 13 13:27:03.263006 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 127/226] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:03 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:03.417506 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-74796c55-13ad-450c-895f-104eb4becd1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:03.418555 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-74796c55-13ad-450c-895f-104eb4becd1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:03.429485 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-74796c55-13ad-450c-895f-104eb4becd1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:03.429987 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-74796c55-13ad-450c-895f-104eb4becd1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:03.430783 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-74796c55-13ad-450c-895f-104eb4becd1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:03.431226 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-74796c55-13ad-450c-895f-104eb4becd1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:03.568842 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-74796c55-13ad-450c-895f-104eb4becd1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:03.577083 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-74796c55-13ad-450c-895f-104eb4becd1a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1509 microversion: 2.1 time: 0.163956 May 13 13:27:03.577837 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 100/227] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:03 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:03.680664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-364aecc9-2b52-4c67-915c-b7382de9e978 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:03.681051 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-364aecc9-2b52-4c67-915c-b7382de9e978 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:03.693095 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-364aecc9-2b52-4c67-915c-b7382de9e978 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:03.694004 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-364aecc9-2b52-4c67-915c-b7382de9e978 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:03.694830 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-364aecc9-2b52-4c67-915c-b7382de9e978 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:03.695408 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-364aecc9-2b52-4c67-915c-b7382de9e978 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:03.845317 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-364aecc9-2b52-4c67-915c-b7382de9e978 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:03.857631 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-364aecc9-2b52-4c67-915c-b7382de9e978 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1314 microversion: 2.1 time: 0.180565 May 13 13:27:03.858362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 128/228] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:03 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:04.280261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3df872f9-69c2-4ef7-bafa-8510119c2c4c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:04.280864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3df872f9-69c2-4ef7-bafa-8510119c2c4c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:04.286597 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3df872f9-69c2-4ef7-bafa-8510119c2c4c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:04.287038 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3df872f9-69c2-4ef7-bafa-8510119c2c4c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:04.287796 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3df872f9-69c2-4ef7-bafa-8510119c2c4c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:04.288217 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3df872f9-69c2-4ef7-bafa-8510119c2c4c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:04.463888 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3df872f9-69c2-4ef7-bafa-8510119c2c4c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:04.472445 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3df872f9-69c2-4ef7-bafa-8510119c2c4c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:04.476750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3df872f9-69c2-4ef7-bafa-8510119c2c4c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:04.476750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3df872f9-69c2-4ef7-bafa-8510119c2c4c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.198861 May 13 13:27:04.476750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 101/229] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:04 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:04.594639 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9c72d986-dbbf-43c8-85ba-0c8c363290a1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:04.595261 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9c72d986-dbbf-43c8-85ba-0c8c363290a1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:04.601752 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9c72d986-dbbf-43c8-85ba-0c8c363290a1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:04.602396 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9c72d986-dbbf-43c8-85ba-0c8c363290a1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:04.603316 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9c72d986-dbbf-43c8-85ba-0c8c363290a1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:04.603822 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9c72d986-dbbf-43c8-85ba-0c8c363290a1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:04.737508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9c72d986-dbbf-43c8-85ba-0c8c363290a1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:04.744874 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9c72d986-dbbf-43c8-85ba-0c8c363290a1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1515 microversion: 2.1 time: 0.154277 May 13 13:27:04.745444 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 129/230] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:04 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:04.876420 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ab1af134-73a8-4652-bded-1c4aae53bf56 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:04.877370 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ab1af134-73a8-4652-bded-1c4aae53bf56 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:04.886246 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ab1af134-73a8-4652-bded-1c4aae53bf56 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:04.886901 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ab1af134-73a8-4652-bded-1c4aae53bf56 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:04.887839 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ab1af134-73a8-4652-bded-1c4aae53bf56 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:04.888432 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ab1af134-73a8-4652-bded-1c4aae53bf56 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:05.037308 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ab1af134-73a8-4652-bded-1c4aae53bf56 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:05.044966 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ab1af134-73a8-4652-bded-1c4aae53bf56 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1314 microversion: 2.1 time: 0.173818 May 13 13:27:05.046178 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 102/231] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:04 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:05.495003 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ebdbb53b-88e2-4a74-98c2-fcdb71aed76d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:05.495613 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ebdbb53b-88e2-4a74-98c2-fcdb71aed76d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:05.502036 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebdbb53b-88e2-4a74-98c2-fcdb71aed76d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:05.502442 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebdbb53b-88e2-4a74-98c2-fcdb71aed76d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:05.503399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebdbb53b-88e2-4a74-98c2-fcdb71aed76d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:05.503832 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebdbb53b-88e2-4a74-98c2-fcdb71aed76d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:05.649964 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ebdbb53b-88e2-4a74-98c2-fcdb71aed76d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:05.659189 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ebdbb53b-88e2-4a74-98c2-fcdb71aed76d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:05.660705 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ebdbb53b-88e2-4a74-98c2-fcdb71aed76d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:05.661919 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ebdbb53b-88e2-4a74-98c2-fcdb71aed76d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.171062 May 13 13:27:05.662500 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 130/232] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:05 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:06.063238 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-99af681b-481d-495b-8cbf-1f47e2367024 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:06.063848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-99af681b-481d-495b-8cbf-1f47e2367024 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:06.070414 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-99af681b-481d-495b-8cbf-1f47e2367024 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:06.070858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-99af681b-481d-495b-8cbf-1f47e2367024 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:06.077724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-99af681b-481d-495b-8cbf-1f47e2367024 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:06.077724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-99af681b-481d-495b-8cbf-1f47e2367024 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:06.207605 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-99af681b-481d-495b-8cbf-1f47e2367024 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:06.214896 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-99af681b-481d-495b-8cbf-1f47e2367024 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1314 microversion: 2.1 time: 0.156350 May 13 13:27:06.215455 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 103/233] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:06 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:06.675312 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6c26fc92-f4bc-4e0c-8b35-732a2bbaa2ae tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Action: 'create', calling method: .version_select at 0x7faaa218a4c0>, body: {"keypair": {"name": "tempest-keypair-696172800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDN0T/XbOqV1BKrge3lmb3UMzPJXRmcxCDFLIf1tNEirH0NBV/FkhrznboE+Q4SXiXqV5N/37e5qYsjJJt88zlWWHUug6IezQftYiBmFBN9saAbAEL3kkSWJiTrs9Yha1w=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:06.688158 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0cf7e295-b1e1-483e-b57e-dfe56ba86f4e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:06.688850 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0cf7e295-b1e1-483e-b57e-dfe56ba86f4e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:06.695703 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0cf7e295-b1e1-483e-b57e-dfe56ba86f4e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:06.696399 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0cf7e295-b1e1-483e-b57e-dfe56ba86f4e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:06.697557 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0cf7e295-b1e1-483e-b57e-dfe56ba86f4e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:06.698459 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0cf7e295-b1e1-483e-b57e-dfe56ba86f4e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:06.700155 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-6c26fc92-f4bc-4e0c-8b35-732a2bbaa2ae tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Getting quotas for project e25902914d244bfeaa038f24838c28ca. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:27:06.712243 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-6c26fc92-f4bc-4e0c-8b35-732a2bbaa2ae tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Getting quotas for user f56c908ada31445e85ec1dfee8e2ebdb and project e25902914d244bfeaa038f24838c28ca. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:27:06.831123 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6c26fc92-f4bc-4e0c-8b35-732a2bbaa2ae tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.162035 May 13 13:27:06.831645 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 131/234] 10.222.0.25 () {60 vars in 1158 bytes} [Fri May 13 13:27:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:06.836755 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f5c4887d-f330-44ca-8335-288b040548b6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:06.843877 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f5c4887d-f330-44ca-8335-288b040548b6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:06.844234 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f5c4887d-f330-44ca-8335-288b040548b6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:06.851697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0cf7e295-b1e1-483e-b57e-dfe56ba86f4e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:06.863429 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0cf7e295-b1e1-483e-b57e-dfe56ba86f4e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:06.865933 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0cf7e295-b1e1-483e-b57e-dfe56ba86f4e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:06.868090 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0cf7e295-b1e1-483e-b57e-dfe56ba86f4e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.191161 May 13 13:27:06.868998 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 104/235] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:06 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:06.906501 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f5c4887d-f330-44ca-8335-288b040548b6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Going to try to stop instance {{(pid=117603) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 13:27:07.081824 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f5c4887d-f330-44ca-8335-288b040548b6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "POST /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/action" status: 202 len: 0 microversion: 2.1 time: 0.248895 May 13 13:27:07.082457 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 132/236] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:27:06 2022] POST /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:27:07.092034 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f510daf7-ac51-4e1c-b4bb-3323d0d92d4f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:07.093406 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f510daf7-ac51-4e1c-b4bb-3323d0d92d4f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:07.100583 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f510daf7-ac51-4e1c-b4bb-3323d0d92d4f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:07.101097 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f510daf7-ac51-4e1c-b4bb-3323d0d92d4f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:07.102002 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f510daf7-ac51-4e1c-b4bb-3323d0d92d4f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:07.102449 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f510daf7-ac51-4e1c-b4bb-3323d0d92d4f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:07.232015 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f510daf7-ac51-4e1c-b4bb-3323d0d92d4f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:07.232181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2f6adf81-4f87-4736-a9a0-01321c40ebb6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:07.233022 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2f6adf81-4f87-4736-a9a0-01321c40ebb6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:07.239242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f6adf81-4f87-4736-a9a0-01321c40ebb6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:07.239695 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f6adf81-4f87-4736-a9a0-01321c40ebb6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:07.240291 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f510daf7-ac51-4e1c-b4bb-3323d0d92d4f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.153469 May 13 13:27:07.240472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f6adf81-4f87-4736-a9a0-01321c40ebb6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:07.240911 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f6adf81-4f87-4736-a9a0-01321c40ebb6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:07.241137 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 105/237] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:07 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:07.408893 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2f6adf81-4f87-4736-a9a0-01321c40ebb6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:07.416113 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2f6adf81-4f87-4736-a9a0-01321c40ebb6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1498 microversion: 2.1 time: 0.188380 May 13 13:27:07.416679 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 133/238] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:07 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:07.887087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-be4df690-017d-412c-950e-50bc21ff65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:07.887639 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-be4df690-017d-412c-950e-50bc21ff65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:07.893598 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-be4df690-017d-412c-950e-50bc21ff65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:07.894075 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-be4df690-017d-412c-950e-50bc21ff65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:07.894833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-be4df690-017d-412c-950e-50bc21ff65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:07.895316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-be4df690-017d-412c-950e-50bc21ff65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:08.044672 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-be4df690-017d-412c-950e-50bc21ff65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:08.053155 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-be4df690-017d-412c-950e-50bc21ff65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:08.054780 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-be4df690-017d-412c-950e-50bc21ff65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:08.055948 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-be4df690-017d-412c-950e-50bc21ff65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.173174 May 13 13:27:08.056510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 106/239] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:07 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:08.258537 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1b8ad56c-97fe-4343-8491-66ce61530210 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:08.259391 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1b8ad56c-97fe-4343-8491-66ce61530210 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:08.265374 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1b8ad56c-97fe-4343-8491-66ce61530210 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:08.265848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1b8ad56c-97fe-4343-8491-66ce61530210 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:08.266738 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1b8ad56c-97fe-4343-8491-66ce61530210 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:08.267183 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1b8ad56c-97fe-4343-8491-66ce61530210 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:08.395998 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1b8ad56c-97fe-4343-8491-66ce61530210 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:08.404323 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1b8ad56c-97fe-4343-8491-66ce61530210 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.149681 May 13 13:27:08.405496 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 134/240] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:08 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:09.074443 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b1fca7d8-db05-4a12-9617-ba66988cafd2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:09.075054 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b1fca7d8-db05-4a12-9617-ba66988cafd2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:09.081891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b1fca7d8-db05-4a12-9617-ba66988cafd2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:09.082341 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b1fca7d8-db05-4a12-9617-ba66988cafd2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:09.083133 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b1fca7d8-db05-4a12-9617-ba66988cafd2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:09.083589 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b1fca7d8-db05-4a12-9617-ba66988cafd2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:09.237591 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b1fca7d8-db05-4a12-9617-ba66988cafd2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:09.245331 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b1fca7d8-db05-4a12-9617-ba66988cafd2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:09.246872 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b1fca7d8-db05-4a12-9617-ba66988cafd2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:09.248028 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b1fca7d8-db05-4a12-9617-ba66988cafd2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.177766 May 13 13:27:09.249272 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 107/241] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:09 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:09.357393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2006036513", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac9a1bdf-5ea7-4967-be4e-67b8e1ea2be2"}], "security_groups": [{"name": "tempest-securitygroup--1538050339"}], "key_name": "tempest-keypair-696172800", "user_data": "}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:09.422110 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-21f47ef3-3a53-478a-b208-db7a0ac50c1c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:09.422719 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-21f47ef3-3a53-478a-b208-db7a0ac50c1c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:09.428546 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21f47ef3-3a53-478a-b208-db7a0ac50c1c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:09.429000 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21f47ef3-3a53-478a-b208-db7a0ac50c1c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:09.429768 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21f47ef3-3a53-478a-b208-db7a0ac50c1c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:09.430227 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21f47ef3-3a53-478a-b208-db7a0ac50c1c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:09.455608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] validate_networks() for [('ac9a1bdf-5ea7-4967-be4e-67b8e1ea2be2', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:27:09.564604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-21f47ef3-3a53-478a-b208-db7a0ac50c1c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:09.572548 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-21f47ef3-3a53-478a-b208-db7a0ac50c1c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.154909 May 13 13:27:09.573120 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 108/242] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:09 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:09.826066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:27:09.827034 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:27:09.827511 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:27:09.827920 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:27:09.828360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:27:09.836901 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:09.837353 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:09.838203 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:09.838630 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:09.855214 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Getting quotas for project e25902914d244bfeaa038f24838c28ca. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:27:09.859117 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Getting quotas for user f56c908ada31445e85ec1dfee8e2ebdb and project e25902914d244bfeaa038f24838c28ca. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:27:09.869916 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:27:09.872169 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:27:10.036660 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2208d29d-175b-46c5-b90e-0f604dd9b6c4 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.683719 May 13 13:27:10.037225 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 135/243] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:27:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:27:10.047495 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a281071e-98d5-40a0-9c49-8651821c16f6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:10.048107 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a281071e-98d5-40a0-9c49-8651821c16f6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:10.100327 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a281071e-98d5-40a0-9c49-8651821c16f6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:10.108377 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a281071e-98d5-40a0-9c49-8651821c16f6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1245 microversion: 2.1 time: 0.064910 May 13 13:27:10.109051 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 109/244] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:10 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1245 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:10.267430 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7dbce0c9-96ec-4fac-acc2-60c2a42c5ae6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:10.268045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7dbce0c9-96ec-4fac-acc2-60c2a42c5ae6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:10.274595 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7dbce0c9-96ec-4fac-acc2-60c2a42c5ae6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:10.275054 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7dbce0c9-96ec-4fac-acc2-60c2a42c5ae6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:10.275884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7dbce0c9-96ec-4fac-acc2-60c2a42c5ae6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:10.276330 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7dbce0c9-96ec-4fac-acc2-60c2a42c5ae6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:10.443509 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7dbce0c9-96ec-4fac-acc2-60c2a42c5ae6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:10.452256 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7dbce0c9-96ec-4fac-acc2-60c2a42c5ae6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:10.453759 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7dbce0c9-96ec-4fac-acc2-60c2a42c5ae6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:10.454932 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7dbce0c9-96ec-4fac-acc2-60c2a42c5ae6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.192256 May 13 13:27:10.455494 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 136/245] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:10 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:10.590529 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-14822a23-6abf-44a5-8e97-4469a0538362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:10.591695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-14822a23-6abf-44a5-8e97-4469a0538362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:10.599515 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-14822a23-6abf-44a5-8e97-4469a0538362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:10.599958 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-14822a23-6abf-44a5-8e97-4469a0538362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:10.600921 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-14822a23-6abf-44a5-8e97-4469a0538362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:10.601345 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-14822a23-6abf-44a5-8e97-4469a0538362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:10.750617 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-14822a23-6abf-44a5-8e97-4469a0538362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:10.759053 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-14822a23-6abf-44a5-8e97-4469a0538362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.173868 May 13 13:27:10.759626 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 110/246] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:10 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:11.112443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3e7abeca-49c3-45e2-af22-5508ec48e563 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:11.112934 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3e7abeca-49c3-45e2-af22-5508ec48e563 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:11.119337 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3e7abeca-49c3-45e2-af22-5508ec48e563 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:11.119337 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3e7abeca-49c3-45e2-af22-5508ec48e563 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:11.120147 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3e7abeca-49c3-45e2-af22-5508ec48e563 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:11.120564 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3e7abeca-49c3-45e2-af22-5508ec48e563 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:11.126137 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-791f5ba8-5b82-4025-9e32-e23e8de8ec9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:11.127087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-791f5ba8-5b82-4025-9e32-e23e8de8ec9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:11.134160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-791f5ba8-5b82-4025-9e32-e23e8de8ec9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:11.134616 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-791f5ba8-5b82-4025-9e32-e23e8de8ec9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:11.136142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-791f5ba8-5b82-4025-9e32-e23e8de8ec9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:11.136486 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-791f5ba8-5b82-4025-9e32-e23e8de8ec9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:11.169815 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3e7abeca-49c3-45e2-af22-5508ec48e563 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:27:11.207696 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-791f5ba8-5b82-4025-9e32-e23e8de8ec9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:11.215116 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-791f5ba8-5b82-4025-9e32-e23e8de8ec9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1249 microversion: 2.1 time: 0.094355 May 13 13:27:11.215772 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 111/247] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:11 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:11.220211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1641349028", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "networks": [{"uuid": "0b9976ff-cf79-4330-8132-342b84c98512"}]}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:11.288251 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.network.neutron [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] validate_networks() for [('0b9976ff-cf79-4330-8132-342b84c98512', None, None, None, None, None)] {{(pid=117602) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:27:11.698164 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3e7abeca-49c3-45e2-af22-5508ec48e563 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 204 len: 0 microversion: 2.1 time: 0.589086 May 13 13:27:11.705261 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 137/248] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:27:11 2022] DELETE /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:27:11.710806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1d885f8b-9530-40c1-b6ba-d88206d44553 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:11.711514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1d885f8b-9530-40c1-b6ba-d88206d44553 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:11.717942 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1d885f8b-9530-40c1-b6ba-d88206d44553 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:11.718428 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1d885f8b-9530-40c1-b6ba-d88206d44553 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:11.719213 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1d885f8b-9530-40c1-b6ba-d88206d44553 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:11.719672 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1d885f8b-9530-40c1-b6ba-d88206d44553 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:11.821940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Flavor limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:27:11.822372 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Image limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:27:11.822906 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Flavor pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:27:11.823639 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Image pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:27:11.824087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:27:11.833580 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:11.844509 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:11.844509 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:11.844509 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:11.858641 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Getting quotas for project b361133457c04e2da4c4158a45bbcf19. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:27:11.863064 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Getting quotas for user 15932bb7b3044a41942b4e0edecebf10 and project b361133457c04e2da4c4158a45bbcf19. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:27:11.876303 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1d885f8b-9530-40c1-b6ba-d88206d44553 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:11.876584 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Going to run 1 instances... {{(pid=117602) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:27:11.884171 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:27:11.886037 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1d885f8b-9530-40c1-b6ba-d88206d44553 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:11.887720 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1d885f8b-9530-40c1-b6ba-d88206d44553 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:11.890548 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1d885f8b-9530-40c1-b6ba-d88206d44553 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.183977 May 13 13:27:11.891435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 138/249] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:11 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:11.896643 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-32ad6e1c-ba8d-4832-90da-f106b1fadd46 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:11.897406 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-32ad6e1c-ba8d-4832-90da-f106b1fadd46 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:11.904179 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-32ad6e1c-ba8d-4832-90da-f106b1fadd46 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:11.906761 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-32ad6e1c-ba8d-4832-90da-f106b1fadd46 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:11.907818 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-32ad6e1c-ba8d-4832-90da-f106b1fadd46 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:11.908258 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-32ad6e1c-ba8d-4832-90da-f106b1fadd46 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:12.007492 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-79df1f7d-b6b8-412a-b4cc-a461025f5b93 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790657 May 13 13:27:12.008156 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 112/250] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:27:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:27:12.018326 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0c45b886-1bd3-42e0-a7a1-81eda1ad0b90 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:12.018944 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0c45b886-1bd3-42e0-a7a1-81eda1ad0b90 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:12.053085 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0c45b886-1bd3-42e0-a7a1-81eda1ad0b90 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:12.053951 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0c45b886-1bd3-42e0-a7a1-81eda1ad0b90 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:12.054904 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0c45b886-1bd3-42e0-a7a1-81eda1ad0b90 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:12.055500 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0c45b886-1bd3-42e0-a7a1-81eda1ad0b90 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:12.056506 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-32ad6e1c-ba8d-4832-90da-f106b1fadd46 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:12.064923 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-32ad6e1c-ba8d-4832-90da-f106b1fadd46 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1504 microversion: 2.1 time: 0.172343 May 13 13:27:12.065539 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 139/251] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:11 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:12.078758 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d2d992bb-7530-4e94-ada3-756b8a9ebcd4 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:12.078758 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d2d992bb-7530-4e94-ada3-756b8a9ebcd4 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:12.150800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d2d992bb-7530-4e94-ada3-756b8a9ebcd4 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:12.157694 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d2d992bb-7530-4e94-ada3-756b8a9ebcd4 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1219 microversion: 2.1 time: 0.090830 May 13 13:27:12.158370 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 140/252] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:12 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:12.231501 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8a68ea34-3ddd-4718-b848-8d3b5dae33eb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:12.232107 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8a68ea34-3ddd-4718-b848-8d3b5dae33eb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:12.237949 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a68ea34-3ddd-4718-b848-8d3b5dae33eb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:12.238404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a68ea34-3ddd-4718-b848-8d3b5dae33eb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:12.239201 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a68ea34-3ddd-4718-b848-8d3b5dae33eb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:12.239639 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a68ea34-3ddd-4718-b848-8d3b5dae33eb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:12.244697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0c45b886-1bd3-42e0-a7a1-81eda1ad0b90 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:12.253321 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0c45b886-1bd3-42e0-a7a1-81eda1ad0b90 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.238929 May 13 13:27:12.254323 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 113/253] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:12 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:12.306527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8a68ea34-3ddd-4718-b848-8d3b5dae33eb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:12.314418 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8a68ea34-3ddd-4718-b848-8d3b5dae33eb tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1241 microversion: 2.1 time: 0.086868 May 13 13:27:12.314987 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 141/254] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:12 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:12.908943 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5300e473-b0b1-4a46-ae2f-a291b4571a54 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:12.909730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-5300e473-b0b1-4a46-ae2f-a291b4571a54 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:12.915549 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5300e473-b0b1-4a46-ae2f-a291b4571a54 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:12.918295 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5300e473-b0b1-4a46-ae2f-a291b4571a54 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:12.918295 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5300e473-b0b1-4a46-ae2f-a291b4571a54 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:12.918295 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5300e473-b0b1-4a46-ae2f-a291b4571a54 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:13.043246 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-5300e473-b0b1-4a46-ae2f-a291b4571a54 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:13.051604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-5300e473-b0b1-4a46-ae2f-a291b4571a54 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:13.053131 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-5300e473-b0b1-4a46-ae2f-a291b4571a54 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:13.054361 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-5300e473-b0b1-4a46-ae2f-a291b4571a54 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.149859 May 13 13:27:13.054916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 114/255] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:12 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:13.082549 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3b85b53b-93a2-4e4d-b2be-ced518a69d95 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:13.083168 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3b85b53b-93a2-4e4d-b2be-ced518a69d95 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:13.089102 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b85b53b-93a2-4e4d-b2be-ced518a69d95 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:13.090279 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b85b53b-93a2-4e4d-b2be-ced518a69d95 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:13.090384 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b85b53b-93a2-4e4d-b2be-ced518a69d95 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:13.090795 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b85b53b-93a2-4e4d-b2be-ced518a69d95 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:13.176150 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a5c55d1e-cedc-4ef8-9642-2571582705bc tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:13.176873 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a5c55d1e-cedc-4ef8-9642-2571582705bc tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:13.183534 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a5c55d1e-cedc-4ef8-9642-2571582705bc tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:13.183976 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a5c55d1e-cedc-4ef8-9642-2571582705bc tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:13.184840 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a5c55d1e-cedc-4ef8-9642-2571582705bc tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:13.197085 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a5c55d1e-cedc-4ef8-9642-2571582705bc tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:13.219901 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3b85b53b-93a2-4e4d-b2be-ced518a69d95 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:13.227371 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3b85b53b-93a2-4e4d-b2be-ced518a69d95 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1504 microversion: 2.1 time: 0.148703 May 13 13:27:13.227948 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 142/256] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:13 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:13.246031 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a5c55d1e-cedc-4ef8-9642-2571582705bc tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:13.253597 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a5c55d1e-cedc-4ef8-9642-2571582705bc tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1223 microversion: 2.1 time: 0.081221 May 13 13:27:13.254321 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 115/257] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:13 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:13.271139 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b6a3189c-304f-4155-a4f9-fa900a34f8a3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:13.271760 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b6a3189c-304f-4155-a4f9-fa900a34f8a3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:13.277816 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b6a3189c-304f-4155-a4f9-fa900a34f8a3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:13.278280 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b6a3189c-304f-4155-a4f9-fa900a34f8a3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:13.279092 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b6a3189c-304f-4155-a4f9-fa900a34f8a3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:13.280159 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b6a3189c-304f-4155-a4f9-fa900a34f8a3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:13.332681 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-41fdf713-f16a-456d-bb35-f2ee3271b4ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:13.333290 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-41fdf713-f16a-456d-bb35-f2ee3271b4ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:13.339361 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-41fdf713-f16a-456d-bb35-f2ee3271b4ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:13.339820 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-41fdf713-f16a-456d-bb35-f2ee3271b4ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:13.340694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-41fdf713-f16a-456d-bb35-f2ee3271b4ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:13.341477 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-41fdf713-f16a-456d-bb35-f2ee3271b4ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:13.408666 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-41fdf713-f16a-456d-bb35-f2ee3271b4ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:13.415009 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b6a3189c-304f-4155-a4f9-fa900a34f8a3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:13.416203 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-41fdf713-f16a-456d-bb35-f2ee3271b4ad tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1241 microversion: 2.1 time: 0.087754 May 13 13:27:13.418510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 116/258] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:13 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:13.424103 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b6a3189c-304f-4155-a4f9-fa900a34f8a3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.156384 May 13 13:27:13.424679 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 143/259] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:13 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:14.072868 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4b652621-9358-4041-a7d9-290eee3e1896 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:14.077449 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-4b652621-9358-4041-a7d9-290eee3e1896 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:14.083423 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4b652621-9358-4041-a7d9-290eee3e1896 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.083895 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4b652621-9358-4041-a7d9-290eee3e1896 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.085552 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4b652621-9358-4041-a7d9-290eee3e1896 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.086273 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4b652621-9358-4041-a7d9-290eee3e1896 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.219150 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-4b652621-9358-4041-a7d9-290eee3e1896 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:14.227815 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-4b652621-9358-4041-a7d9-290eee3e1896 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:14.229331 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-4b652621-9358-4041-a7d9-290eee3e1896 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:14.230620 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4b652621-9358-4041-a7d9-290eee3e1896 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.161772 May 13 13:27:14.231179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 117/260] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:14 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:14.244162 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1f7c757a-f013-4545-8a3a-c312edb75f23 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:14.244775 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1f7c757a-f013-4545-8a3a-c312edb75f23 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:14.251970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1f7c757a-f013-4545-8a3a-c312edb75f23 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.252610 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1f7c757a-f013-4545-8a3a-c312edb75f23 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.253565 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1f7c757a-f013-4545-8a3a-c312edb75f23 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.254207 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1f7c757a-f013-4545-8a3a-c312edb75f23 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.263046 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-d59222a7-c63b-4416-8c79-2a7aca6cc3d4 req-7fb75132-cb90-4c6f-a35e-65be0f7fec0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ebf9462-f8b5-4711-b5cf-0a8be1c9e529", "name": "network-vif-deleted", "tag": "c3b1b4a5-4ef8-40ce-91a1-82b1cdfb9e5f"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:14.271699 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-d59222a7-c63b-4416-8c79-2a7aca6cc3d4 req-7fb75132-cb90-4c6f-a35e-65be0f7fec0c service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.272228 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-d59222a7-c63b-4416-8c79-2a7aca6cc3d4 req-7fb75132-cb90-4c6f-a35e-65be0f7fec0c service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.283541 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-d59222a7-c63b-4416-8c79-2a7aca6cc3d4 req-7fb75132-cb90-4c6f-a35e-65be0f7fec0c service nova] Creating event network-vif-deleted:c3b1b4a5-4ef8-40ce-91a1-82b1cdfb9e5f for instance 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 on hv-cinder-84159 May 13 13:27:14.289456 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-d59222a7-c63b-4416-8c79-2a7aca6cc3d4 req-7fb75132-cb90-4c6f-a35e-65be0f7fec0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029996 May 13 13:27:14.290093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 118/261] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:27:14.295799 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9d926c54-a885-407c-96e5-a9ebcb81edd8 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:14.296622 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-9d926c54-a885-407c-96e5-a9ebcb81edd8 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:14.302865 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9d926c54-a885-407c-96e5-a9ebcb81edd8 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.303516 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9d926c54-a885-407c-96e5-a9ebcb81edd8 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.304301 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9d926c54-a885-407c-96e5-a9ebcb81edd8 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.304947 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9d926c54-a885-407c-96e5-a9ebcb81edd8 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.325191 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1f7c757a-f013-4545-8a3a-c312edb75f23 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:14.332638 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1f7c757a-f013-4545-8a3a-c312edb75f23 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1462 microversion: 2.1 time: 0.092202 May 13 13:27:14.333389 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 144/262] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:14 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1462 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:14.370248 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-9d926c54-a885-407c-96e5-a9ebcb81edd8 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:14.377526 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-9d926c54-a885-407c-96e5-a9ebcb81edd8 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1215 microversion: 2.1 time: 0.086141 May 13 13:27:14.378132 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 119/263] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:14 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:14.433358 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f7e417cf-ec39-4030-8ef4-11e6445605e8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:14.434012 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f7e417cf-ec39-4030-8ef4-11e6445605e8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:14.440213 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-da97c886-772b-4219-8f74-3a31f14c5a08 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:14.440394 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7e417cf-ec39-4030-8ef4-11e6445605e8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.440684 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7e417cf-ec39-4030-8ef4-11e6445605e8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.440867 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-da97c886-772b-4219-8f74-3a31f14c5a08 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:14.441451 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7e417cf-ec39-4030-8ef4-11e6445605e8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.441906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f7e417cf-ec39-4030-8ef4-11e6445605e8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.446655 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-da97c886-772b-4219-8f74-3a31f14c5a08 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.447127 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-da97c886-772b-4219-8f74-3a31f14c5a08 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.447900 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-da97c886-772b-4219-8f74-3a31f14c5a08 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:14.448581 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-da97c886-772b-4219-8f74-3a31f14c5a08 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:14.510128 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f7e417cf-ec39-4030-8ef4-11e6445605e8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:14.518742 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f7e417cf-ec39-4030-8ef4-11e6445605e8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1297 microversion: 2.1 time: 0.088849 May 13 13:27:14.521090 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 145/264] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:14 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:14.595973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-da97c886-772b-4219-8f74-3a31f14c5a08 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:14.604043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-da97c886-772b-4219-8f74-3a31f14c5a08 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.167503 May 13 13:27:14.604704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 120/265] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:14 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:15.249948 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7e0eb767-743f-48aa-b747-e140a6530c97 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:15.250558 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7e0eb767-743f-48aa-b747-e140a6530c97 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:15.256339 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e0eb767-743f-48aa-b747-e140a6530c97 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.256790 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e0eb767-743f-48aa-b747-e140a6530c97 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.257555 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e0eb767-743f-48aa-b747-e140a6530c97 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.258017 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e0eb767-743f-48aa-b747-e140a6530c97 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.350409 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3086bc5f-3e94-4dc1-b81b-23689e3fec01 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:15.351022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3086bc5f-3e94-4dc1-b81b-23689e3fec01 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:15.357480 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3086bc5f-3e94-4dc1-b81b-23689e3fec01 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.358869 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3086bc5f-3e94-4dc1-b81b-23689e3fec01 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.358869 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3086bc5f-3e94-4dc1-b81b-23689e3fec01 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.359354 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3086bc5f-3e94-4dc1-b81b-23689e3fec01 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.397156 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3086bc5f-3e94-4dc1-b81b-23689e3fec01 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.397617 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3086bc5f-3e94-4dc1-b81b-23689e3fec01 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.398111 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-3086bc5f-3e94-4dc1-b81b-23689e3fec01 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lazy-loading 'fault' on Instance uuid 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:27:15.446799 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3086bc5f-3e94-4dc1-b81b-23689e3fec01 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:15.458176 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3086bc5f-3e94-4dc1-b81b-23689e3fec01 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 200 len: 1304 microversion: 2.1 time: 0.111593 May 13 13:27:15.468420 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 121/266] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:15 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:15.479722 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-35aafe52-f0af-4eea-ac72-c5320d6756ff tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:15.481260 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-35aafe52-f0af-4eea-ac72-c5320d6756ff tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:15.488324 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-35aafe52-f0af-4eea-ac72-c5320d6756ff tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.489176 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-35aafe52-f0af-4eea-ac72-c5320d6756ff tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.490183 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-35aafe52-f0af-4eea-ac72-c5320d6756ff tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.490621 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-35aafe52-f0af-4eea-ac72-c5320d6756ff tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.566918 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-35aafe52-f0af-4eea-ac72-c5320d6756ff tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:15.573182 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-35aafe52-f0af-4eea-ac72-c5320d6756ff tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1271 microversion: 2.1 time: 0.103471 May 13 13:27:15.581778 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 122/267] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:15 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:15.581778 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a35e508c-3737-4e78-b9b1-67209078b47b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:15.581778 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a35e508c-3737-4e78-b9b1-67209078b47b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:15.586422 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a35e508c-3737-4e78-b9b1-67209078b47b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.586883 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a35e508c-3737-4e78-b9b1-67209078b47b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.587712 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a35e508c-3737-4e78-b9b1-67209078b47b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.588162 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a35e508c-3737-4e78-b9b1-67209078b47b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.659089 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a35e508c-3737-4e78-b9b1-67209078b47b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:15.672280 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a35e508c-3737-4e78-b9b1-67209078b47b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1303 microversion: 2.1 time: 0.092151 May 13 13:27:15.672280 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 123/268] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:15 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:15.674822 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ab643902-ca57-48a5-8233-b1d287841dd2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:15.675349 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ab643902-ca57-48a5-8233-b1d287841dd2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:15.684733 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ab643902-ca57-48a5-8233-b1d287841dd2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.687341 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ab643902-ca57-48a5-8233-b1d287841dd2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.688279 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ab643902-ca57-48a5-8233-b1d287841dd2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:15.689901 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ab643902-ca57-48a5-8233-b1d287841dd2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:15.730584 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7e0eb767-743f-48aa-b747-e140a6530c97 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:15.741594 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7e0eb767-743f-48aa-b747-e140a6530c97 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:15.743201 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7e0eb767-743f-48aa-b747-e140a6530c97 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:15.745015 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7e0eb767-743f-48aa-b747-e140a6530c97 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.499007 May 13 13:27:15.745590 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 146/269] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:15 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:15.877600 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ab643902-ca57-48a5-8233-b1d287841dd2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:15.889611 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ab643902-ca57-48a5-8233-b1d287841dd2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.217903 May 13 13:27:15.889611 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 124/270] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:15 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:16.474890 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2b73a948-bed6-4d6d-9231-21b515c75002 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:16.481972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2b73a948-bed6-4d6d-9231-21b515c75002 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:16.489597 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2b73a948-bed6-4d6d-9231-21b515c75002 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:16.490023 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2b73a948-bed6-4d6d-9231-21b515c75002 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:16.493060 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2b73a948-bed6-4d6d-9231-21b515c75002 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:16.493515 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2b73a948-bed6-4d6d-9231-21b515c75002 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:16.525881 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-2b73a948-bed6-4d6d-9231-21b515c75002 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] HTTP exception thrown: Instance 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 could not be found. May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2b73a948-bed6-4d6d-9231-21b515c75002 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Request method failure captured: May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 HTTP/1.1 May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflyXJf_MG7vS43dEGmSlrpLMsfTbBMo6GVdtYErDDnKEDsZvssgdrtS25OKbtSuATPMHHtbA58avLTyf-U3wAv7URsON0KS2yJqMKI5pPNh4wZKIOmhe4KsGRxzMBTnOOM2bq3AQBt2aZqU5MsvT3TXTrRlkcC2nD1BsXNbibT5CFeE May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 3ea1460c53954c6a915fc638a2690cbf May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesActionsTest-1670340122 May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:27:16.527544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:27:16.529062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea1460c53954c6a915fc638a2690cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ea1460c53954c6a915fc638a2690cbf", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ea1460c53954c6a915fc638a2690cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea1460c53954c6a915fc638a2690cbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:27:16.529062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesActionsTest-1670340122 May 13 13:27:16.529062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 3ea1460c53954c6a915fc638a2690cbf May 13 13:27:16.529062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesActionsTest-1670340122 May 13 13:27:16.529062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesActionsTest-1670340122-project May 13 13:27:16.529062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:27:16.529062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:27:16.529062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 1cdee89f8a8040ca944458d3fc6f18eb May 13 13:27:16.529062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesActionsTest-1670340122-project May 13 13:27:16.529062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:27:16.529062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 could not be found. May 13 13:27:16.529062 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '8ebf9462-f8b5-4711-b5cf-0a8be1c9e529'} May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 could not be found. May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:27:16.535848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 could not be found. May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 could not be found. May 13 13:27:16.537172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:16.541038 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2b73a948-bed6-4d6d-9231-21b515c75002 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Returning 404 to user: Instance 8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:27:16.542020 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2b73a948-bed6-4d6d-9231-21b515c75002 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529" status: 404 len: 111 microversion: 2.1 time: 0.070973 May 13 13:27:16.542885 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 147/271] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:16 2022] GET /compute/v2.1/servers/8ebf9462-f8b5-4711-b5cf-0a8be1c9e529 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:27:16.593237 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a8b9cbef-cdce-4f5f-be68-514cc00181e4 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:16.594545 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a8b9cbef-cdce-4f5f-be68-514cc00181e4 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:16.604012 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8b9cbef-cdce-4f5f-be68-514cc00181e4 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:16.605635 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8b9cbef-cdce-4f5f-be68-514cc00181e4 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:16.606740 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8b9cbef-cdce-4f5f-be68-514cc00181e4 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:16.607640 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8b9cbef-cdce-4f5f-be68-514cc00181e4 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:16.664575 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1929767593", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "networks": [{"uuid": "4811dfd5-b4ea-4a2f-a60d-8cbf48f0d4e7"}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:16.699267 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a8b9cbef-cdce-4f5f-be68-514cc00181e4 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:16.708500 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a8b9cbef-cdce-4f5f-be68-514cc00181e4 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1277 microversion: 2.1 time: 0.120297 May 13 13:27:16.709096 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 125/272] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:16 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:16.713808 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4b33084c-994a-414c-b474-e32aa4b590a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:16.714411 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-4b33084c-994a-414c-b474-e32aa4b590a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:16.721992 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4b33084c-994a-414c-b474-e32aa4b590a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:16.722446 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4b33084c-994a-414c-b474-e32aa4b590a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:16.723572 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4b33084c-994a-414c-b474-e32aa4b590a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:16.724185 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4b33084c-994a-414c-b474-e32aa4b590a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:16.735728 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] validate_networks() for [('4811dfd5-b4ea-4a2f-a60d-8cbf48f0d4e7', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:27:16.935148 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-4b33084c-994a-414c-b474-e32aa4b590a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:16.943547 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4b33084c-994a-414c-b474-e32aa4b590a3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.233427 May 13 13:27:16.944897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 126/273] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:16 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:16.966629 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a7a16b64-b2a6-4080-a6a1-d286dfc9eb77 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:16.968253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a7a16b64-b2a6-4080-a6a1-d286dfc9eb77 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:16.974534 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a7a16b64-b2a6-4080-a6a1-d286dfc9eb77 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:16.975582 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a7a16b64-b2a6-4080-a6a1-d286dfc9eb77 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:16.976839 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a7a16b64-b2a6-4080-a6a1-d286dfc9eb77 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:16.977341 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a7a16b64-b2a6-4080-a6a1-d286dfc9eb77 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:17.379278 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:27:17.379968 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:27:17.380605 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:27:17.384434 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:27:17.385087 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:27:17.395815 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:17.396449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:17.397803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:17.398260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:17.415502 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Getting quotas for project 3ea1460c53954c6a915fc638a2690cbf. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:27:17.419841 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Getting quotas for user 1cdee89f8a8040ca944458d3fc6f18eb and project 3ea1460c53954c6a915fc638a2690cbf. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:27:17.431011 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:27:17.433407 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:27:17.438156 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a7a16b64-b2a6-4080-a6a1-d286dfc9eb77 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:17.447276 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a7a16b64-b2a6-4080-a6a1-d286dfc9eb77 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:17.449102 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a7a16b64-b2a6-4080-a6a1-d286dfc9eb77 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:17.450341 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a7a16b64-b2a6-4080-a6a1-d286dfc9eb77 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.504361 May 13 13:27:17.450946 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 127/274] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:16 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:17.458002 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6ef528f4-846e-423c-95b2-26c137bdf743 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:17.458798 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6ef528f4-846e-423c-95b2-26c137bdf743 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:17.470273 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6ef528f4-846e-423c-95b2-26c137bdf743 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:17.470273 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6ef528f4-846e-423c-95b2-26c137bdf743 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:17.470273 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6ef528f4-846e-423c-95b2-26c137bdf743 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:17.470273 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6ef528f4-846e-423c-95b2-26c137bdf743 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:17.585438 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4e9d45b5-a752-409c-acc0-8cf45e1836bc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922292 May 13 13:27:17.585438 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 148/275] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:27:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:27:17.594187 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2144a098-e97b-43c8-8e7c-d6bdd962657c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:17.595106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2144a098-e97b-43c8-8e7c-d6bdd962657c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:17.705303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6ef528f4-846e-423c-95b2-26c137bdf743 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:17.714657 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6ef528f4-846e-423c-95b2-26c137bdf743 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.261932 May 13 13:27:17.715967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 128/276] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:17 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:17.733642 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2144a098-e97b-43c8-8e7c-d6bdd962657c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:17.738698 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d61681ab-c732-4370-b345-d886f5c73281 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:17.741526 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2144a098-e97b-43c8-8e7c-d6bdd962657c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1214 microversion: 2.1 time: 0.152002 May 13 13:27:17.750409 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 149/277] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:17 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:17.762174 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d61681ab-c732-4370-b345-d886f5c73281 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:17.773660 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d61681ab-c732-4370-b345-d886f5c73281 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:17.774719 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d61681ab-c732-4370-b345-d886f5c73281 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:17.776648 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d61681ab-c732-4370-b345-d886f5c73281 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:17.777385 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d61681ab-c732-4370-b345-d886f5c73281 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:17.960677 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ea3a3339-df16-4c7e-95e6-dbb9974f0584 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:17.961297 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ea3a3339-df16-4c7e-95e6-dbb9974f0584 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:17.984981 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ea3a3339-df16-4c7e-95e6-dbb9974f0584 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:17.985753 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ea3a3339-df16-4c7e-95e6-dbb9974f0584 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:17.986784 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ea3a3339-df16-4c7e-95e6-dbb9974f0584 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:17.987323 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ea3a3339-df16-4c7e-95e6-dbb9974f0584 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:18.072888 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d61681ab-c732-4370-b345-d886f5c73281 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:18.082989 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d61681ab-c732-4370-b345-d886f5c73281 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.347932 May 13 13:27:18.084635 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 129/278] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:17 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:18.089226 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-08e57693-5da0-4db0-9a64-ee6e6c6bcfb1 req-25df8584-b66d-4105-b0f0-4329c7e7e024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8063f90-dde5-4697-b772-2d63abfae0ec", "tag": "ca45ea26-ebef-4cf1-b670-b108bd4e54d4"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:18.117206 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-08e57693-5da0-4db0-9a64-ee6e6c6bcfb1 req-25df8584-b66d-4105-b0f0-4329c7e7e024 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:18.117674 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-08e57693-5da0-4db0-9a64-ee6e6c6bcfb1 req-25df8584-b66d-4105-b0f0-4329c7e7e024 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:18.131958 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-08e57693-5da0-4db0-9a64-ee6e6c6bcfb1 req-25df8584-b66d-4105-b0f0-4329c7e7e024 service nova] Creating event network-changed:ca45ea26-ebef-4cf1-b670-b108bd4e54d4 for instance c8063f90-dde5-4697-b772-2d63abfae0ec on hv-cinder-84159 May 13 13:27:18.138493 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-08e57693-5da0-4db0-9a64-ee6e6c6bcfb1 req-25df8584-b66d-4105-b0f0-4329c7e7e024 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052067 May 13 13:27:18.140283 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 130/279] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:18.362727 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ea3a3339-df16-4c7e-95e6-dbb9974f0584 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:18.371269 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ea3a3339-df16-4c7e-95e6-dbb9974f0584 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.414148 May 13 13:27:18.371503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 150/280] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:17 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:18.470998 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1765fe5b-f71d-431f-a7c9-ba80b418ab08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:18.472044 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1765fe5b-f71d-431f-a7c9-ba80b418ab08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:18.478927 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1765fe5b-f71d-431f-a7c9-ba80b418ab08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:18.479656 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1765fe5b-f71d-431f-a7c9-ba80b418ab08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:18.480895 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1765fe5b-f71d-431f-a7c9-ba80b418ab08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:18.481594 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1765fe5b-f71d-431f-a7c9-ba80b418ab08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:18.694056 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1765fe5b-f71d-431f-a7c9-ba80b418ab08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:18.702500 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1765fe5b-f71d-431f-a7c9-ba80b418ab08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:18.704005 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1765fe5b-f71d-431f-a7c9-ba80b418ab08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:18.705167 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1765fe5b-f71d-431f-a7c9-ba80b418ab08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.238798 May 13 13:27:18.705738 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 131/281] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:18 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:18.733166 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8ef01852-829b-4a6c-9614-693b54d2ee8f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:18.733717 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8ef01852-829b-4a6c-9614-693b54d2ee8f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:18.739515 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8ef01852-829b-4a6c-9614-693b54d2ee8f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:18.739972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8ef01852-829b-4a6c-9614-693b54d2ee8f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:18.740739 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8ef01852-829b-4a6c-9614-693b54d2ee8f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:18.741178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8ef01852-829b-4a6c-9614-693b54d2ee8f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:18.765429 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b7d9d9ea-70c6-4627-990b-f35b27dcaebc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:18.766227 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b7d9d9ea-70c6-4627-990b-f35b27dcaebc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:18.773090 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b7d9d9ea-70c6-4627-990b-f35b27dcaebc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:18.773599 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b7d9d9ea-70c6-4627-990b-f35b27dcaebc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:18.774460 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b7d9d9ea-70c6-4627-990b-f35b27dcaebc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:18.774904 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b7d9d9ea-70c6-4627-990b-f35b27dcaebc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:18.850630 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b7d9d9ea-70c6-4627-990b-f35b27dcaebc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:18.861022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b7d9d9ea-70c6-4627-990b-f35b27dcaebc tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1218 microversion: 2.1 time: 0.099280 May 13 13:27:18.874253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 132/282] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:18 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:18.876336 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8ef01852-829b-4a6c-9614-693b54d2ee8f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:18.884941 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8ef01852-829b-4a6c-9614-693b54d2ee8f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.156324 May 13 13:27:18.885521 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 151/283] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:18 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:18.911368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-9d298a94-229d-4437-8275-4be3408cefb1 req-942cef6f-61f9-4c06-aee3-32bca18b9f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48e0eae6-6c5f-446e-a5c3-bfccf382c353", "tag": "517c54c5-bfa9-4ac4-b0ba-9b4f1df9e8ad"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:18.919413 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-9d298a94-229d-4437-8275-4be3408cefb1 req-942cef6f-61f9-4c06-aee3-32bca18b9f05 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:18.919947 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-9d298a94-229d-4437-8275-4be3408cefb1 req-942cef6f-61f9-4c06-aee3-32bca18b9f05 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:18.933122 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-9d298a94-229d-4437-8275-4be3408cefb1 req-942cef6f-61f9-4c06-aee3-32bca18b9f05 service nova] Creating event network-changed:517c54c5-bfa9-4ac4-b0ba-9b4f1df9e8ad for instance 48e0eae6-6c5f-446e-a5c3-bfccf382c353 on hv-cinder-84159 May 13 13:27:18.936611 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-9d298a94-229d-4437-8275-4be3408cefb1 req-942cef6f-61f9-4c06-aee3-32bca18b9f05 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029001 May 13 13:27:18.937208 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 133/284] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:19.099857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-aa0197cc-f5fe-453e-a565-06623cf74b9c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:19.100476 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-aa0197cc-f5fe-453e-a565-06623cf74b9c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:19.106433 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aa0197cc-f5fe-453e-a565-06623cf74b9c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.106889 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aa0197cc-f5fe-453e-a565-06623cf74b9c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.108192 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aa0197cc-f5fe-453e-a565-06623cf74b9c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.108656 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aa0197cc-f5fe-453e-a565-06623cf74b9c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.241999 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-aa0197cc-f5fe-453e-a565-06623cf74b9c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:19.249555 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-aa0197cc-f5fe-453e-a565-06623cf74b9c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.153546 May 13 13:27:19.250751 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 152/285] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:19 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:19.388468 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-af15de8b-1d09-4364-91e6-b9f5ce3ca650 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:19.389665 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-af15de8b-1d09-4364-91e6-b9f5ce3ca650 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:19.398121 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-af15de8b-1d09-4364-91e6-b9f5ce3ca650 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.398121 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-af15de8b-1d09-4364-91e6-b9f5ce3ca650 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.398121 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-af15de8b-1d09-4364-91e6-b9f5ce3ca650 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.398121 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-af15de8b-1d09-4364-91e6-b9f5ce3ca650 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.548043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-af15de8b-1d09-4364-91e6-b9f5ce3ca650 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:19.555611 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-af15de8b-1d09-4364-91e6-b9f5ce3ca650 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.171221 May 13 13:27:19.556184 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 134/286] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:19 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:19.723412 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c988d6f6-2f3b-4e57-8a4b-d6a24dd7bb3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:19.724033 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c988d6f6-2f3b-4e57-8a4b-d6a24dd7bb3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:19.730701 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c988d6f6-2f3b-4e57-8a4b-d6a24dd7bb3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.731155 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c988d6f6-2f3b-4e57-8a4b-d6a24dd7bb3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.731943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c988d6f6-2f3b-4e57-8a4b-d6a24dd7bb3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.732385 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c988d6f6-2f3b-4e57-8a4b-d6a24dd7bb3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.868408 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c988d6f6-2f3b-4e57-8a4b-d6a24dd7bb3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:19.878725 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c988d6f6-2f3b-4e57-8a4b-d6a24dd7bb3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:19.879950 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c988d6f6-2f3b-4e57-8a4b-d6a24dd7bb3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:19.881131 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c988d6f6-2f3b-4e57-8a4b-d6a24dd7bb3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.161628 May 13 13:27:19.881685 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 153/287] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:19 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:19.883338 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e3896863-6171-41d9-9a44-440daa0a5985 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:19.887019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e3896863-6171-41d9-9a44-440daa0a5985 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:19.891321 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e3896863-6171-41d9-9a44-440daa0a5985 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.892004 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e3896863-6171-41d9-9a44-440daa0a5985 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.892978 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e3896863-6171-41d9-9a44-440daa0a5985 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.893871 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e3896863-6171-41d9-9a44-440daa0a5985 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.901724 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-76ec9947-06ff-4c50-b738-6136459354be tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:19.902367 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-76ec9947-06ff-4c50-b738-6136459354be tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:19.908742 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76ec9947-06ff-4c50-b738-6136459354be tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.909192 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76ec9947-06ff-4c50-b738-6136459354be tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.910363 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76ec9947-06ff-4c50-b738-6136459354be tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:19.910797 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76ec9947-06ff-4c50-b738-6136459354be tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:19.961748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e3896863-6171-41d9-9a44-440daa0a5985 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:19.969443 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e3896863-6171-41d9-9a44-440daa0a5985 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1218 microversion: 2.1 time: 0.093359 May 13 13:27:19.972788 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 135/288] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:19 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:20.094133 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-76ec9947-06ff-4c50-b738-6136459354be tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:20.101860 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-76ec9947-06ff-4c50-b738-6136459354be tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.203970 May 13 13:27:20.102417 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 154/289] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:19 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:20.266622 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-45e27181-1669-4c11-9397-328f858e8a85 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:20.267350 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-45e27181-1669-4c11-9397-328f858e8a85 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:20.284834 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-45e27181-1669-4c11-9397-328f858e8a85 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:20.285410 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-45e27181-1669-4c11-9397-328f858e8a85 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:20.286632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-45e27181-1669-4c11-9397-328f858e8a85 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:20.287154 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-45e27181-1669-4c11-9397-328f858e8a85 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:20.501034 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-45e27181-1669-4c11-9397-328f858e8a85 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:20.511625 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-45e27181-1669-4c11-9397-328f858e8a85 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.249044 May 13 13:27:20.512794 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 136/290] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:20 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:20.572605 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-582f0c70-9034-484d-9329-394d2fe55591 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:20.573339 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-582f0c70-9034-484d-9329-394d2fe55591 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:20.579872 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-582f0c70-9034-484d-9329-394d2fe55591 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:20.580432 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-582f0c70-9034-484d-9329-394d2fe55591 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:20.581296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-582f0c70-9034-484d-9329-394d2fe55591 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:20.581826 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-582f0c70-9034-484d-9329-394d2fe55591 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:20.736102 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-582f0c70-9034-484d-9329-394d2fe55591 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:20.746847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-582f0c70-9034-484d-9329-394d2fe55591 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.178021 May 13 13:27:20.747439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 155/291] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:20 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:20.905127 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-90b392aa-65c0-4506-8af0-52da6b26423f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:20.905699 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-90b392aa-65c0-4506-8af0-52da6b26423f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:20.912140 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-90b392aa-65c0-4506-8af0-52da6b26423f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:20.924186 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-90b392aa-65c0-4506-8af0-52da6b26423f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:20.924186 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-90b392aa-65c0-4506-8af0-52da6b26423f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:20.924186 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-90b392aa-65c0-4506-8af0-52da6b26423f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:20.988114 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ec152e92-bbc9-49ee-8e1e-8a656eca9728 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:20.988733 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ec152e92-bbc9-49ee-8e1e-8a656eca9728 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:20.997077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ec152e92-bbc9-49ee-8e1e-8a656eca9728 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.002107 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ec152e92-bbc9-49ee-8e1e-8a656eca9728 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:21.003014 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ec152e92-bbc9-49ee-8e1e-8a656eca9728 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.003444 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ec152e92-bbc9-49ee-8e1e-8a656eca9728 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:21.142304 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-90b392aa-65c0-4506-8af0-52da6b26423f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:21.150191 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-90b392aa-65c0-4506-8af0-52da6b26423f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:21.153915 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-90b392aa-65c0-4506-8af0-52da6b26423f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:21.153915 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-90b392aa-65c0-4506-8af0-52da6b26423f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1744 microversion: 2.20 time: 0.252292 May 13 13:27:21.153915 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 137/292] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:20 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1744 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:21.158041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8c095f6b-627e-4a77-baa1-2f84a18475f4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:21.158590 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8c095f6b-627e-4a77-baa1-2f84a18475f4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:21.164827 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8c095f6b-627e-4a77-baa1-2f84a18475f4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.165291 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8c095f6b-627e-4a77-baa1-2f84a18475f4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:21.166131 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8c095f6b-627e-4a77-baa1-2f84a18475f4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.166730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8c095f6b-627e-4a77-baa1-2f84a18475f4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:21.169888 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ec152e92-bbc9-49ee-8e1e-8a656eca9728 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:21.178490 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ec152e92-bbc9-49ee-8e1e-8a656eca9728 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1266 microversion: 2.1 time: 0.194612 May 13 13:27:21.179849 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 156/293] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:20 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:21.399758 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-8c095f6b-627e-4a77-baa1-2f84a18475f4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:21.411795 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8c095f6b-627e-4a77-baa1-2f84a18475f4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.256111 May 13 13:27:21.411795 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 138/294] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:21 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:21.530867 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-81fc347b-3a25-47d7-9a97-c977f9535daf tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:21.531520 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-81fc347b-3a25-47d7-9a97-c977f9535daf tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:21.537350 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81fc347b-3a25-47d7-9a97-c977f9535daf tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.537848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81fc347b-3a25-47d7-9a97-c977f9535daf tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:21.538615 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81fc347b-3a25-47d7-9a97-c977f9535daf tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.539059 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81fc347b-3a25-47d7-9a97-c977f9535daf tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:21.691456 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-81fc347b-3a25-47d7-9a97-c977f9535daf tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:21.701110 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-81fc347b-3a25-47d7-9a97-c977f9535daf tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.174892 May 13 13:27:21.702527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 157/295] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:21 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:21.764567 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d57de10e-f7c8-4acb-bbb9-e788aacfdca3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:21.765188 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d57de10e-f7c8-4acb-bbb9-e788aacfdca3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:21.773019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d57de10e-f7c8-4acb-bbb9-e788aacfdca3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.773019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d57de10e-f7c8-4acb-bbb9-e788aacfdca3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:21.773019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d57de10e-f7c8-4acb-bbb9-e788aacfdca3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:21.773019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d57de10e-f7c8-4acb-bbb9-e788aacfdca3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.044517 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d57de10e-f7c8-4acb-bbb9-e788aacfdca3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:22.052794 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d57de10e-f7c8-4acb-bbb9-e788aacfdca3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.292854 May 13 13:27:22.053864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 139/296] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:21 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:22.172250 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0555c252-ab10-47da-9bce-84c618d99b93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:22.172848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0555c252-ab10-47da-9bce-84c618d99b93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:22.178813 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0555c252-ab10-47da-9bce-84c618d99b93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.179263 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0555c252-ab10-47da-9bce-84c618d99b93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.180022 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0555c252-ab10-47da-9bce-84c618d99b93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.180457 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0555c252-ab10-47da-9bce-84c618d99b93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.198905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6048854d-ac68-46cf-a959-739710ee1343 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:22.199526 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6048854d-ac68-46cf-a959-739710ee1343 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:22.206149 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6048854d-ac68-46cf-a959-739710ee1343 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.206612 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6048854d-ac68-46cf-a959-739710ee1343 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.207391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6048854d-ac68-46cf-a959-739710ee1343 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.207838 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6048854d-ac68-46cf-a959-739710ee1343 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.335429 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0555c252-ab10-47da-9bce-84c618d99b93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:22.356562 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0555c252-ab10-47da-9bce-84c618d99b93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:22.358475 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0555c252-ab10-47da-9bce-84c618d99b93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:22.359972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0555c252-ab10-47da-9bce-84c618d99b93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1744 microversion: 2.20 time: 0.192478 May 13 13:27:22.364061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 158/297] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:22 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1744 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:22.428002 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b7001e96-d883-4220-b8ea-7cd77dd32084 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:22.428806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b7001e96-d883-4220-b8ea-7cd77dd32084 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:22.434975 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7001e96-d883-4220-b8ea-7cd77dd32084 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.435381 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7001e96-d883-4220-b8ea-7cd77dd32084 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.436170 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7001e96-d883-4220-b8ea-7cd77dd32084 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.436733 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b7001e96-d883-4220-b8ea-7cd77dd32084 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.453751 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6048854d-ac68-46cf-a959-739710ee1343 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:22.461257 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6048854d-ac68-46cf-a959-739710ee1343 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1326 microversion: 2.1 time: 0.266470 May 13 13:27:22.461851 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 140/298] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:22 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1326 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:22.573289 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b7001e96-d883-4220-b8ea-7cd77dd32084 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:22.582042 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b7001e96-d883-4220-b8ea-7cd77dd32084 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.157932 May 13 13:27:22.582618 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 159/299] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:22 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:22.720373 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c3e66001-edcc-4864-82cc-fa4372da9d56 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:22.721009 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c3e66001-edcc-4864-82cc-fa4372da9d56 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:22.727023 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c3e66001-edcc-4864-82cc-fa4372da9d56 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.727487 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c3e66001-edcc-4864-82cc-fa4372da9d56 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.728260 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c3e66001-edcc-4864-82cc-fa4372da9d56 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:22.728696 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c3e66001-edcc-4864-82cc-fa4372da9d56 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:22.943424 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c3e66001-edcc-4864-82cc-fa4372da9d56 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:22.950983 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c3e66001-edcc-4864-82cc-fa4372da9d56 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.234349 May 13 13:27:22.961139 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 141/300] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:22 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:23.071702 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4f6d32c1-e7b9-47c4-a04f-7da0b59a3d72 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:23.072359 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4f6d32c1-e7b9-47c4-a04f-7da0b59a3d72 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:23.091826 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4f6d32c1-e7b9-47c4-a04f-7da0b59a3d72 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.094021 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4f6d32c1-e7b9-47c4-a04f-7da0b59a3d72 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:23.096226 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4f6d32c1-e7b9-47c4-a04f-7da0b59a3d72 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.098113 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4f6d32c1-e7b9-47c4-a04f-7da0b59a3d72 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:23.262397 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4f6d32c1-e7b9-47c4-a04f-7da0b59a3d72 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:23.269901 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4f6d32c1-e7b9-47c4-a04f-7da0b59a3d72 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.203133 May 13 13:27:23.270490 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 160/301] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:23 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:23.379419 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4fd4da96-c5ad-4f3c-bc82-4ed48fb1d7f4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:23.380032 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-4fd4da96-c5ad-4f3c-bc82-4ed48fb1d7f4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:23.386054 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4fd4da96-c5ad-4f3c-bc82-4ed48fb1d7f4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.386507 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4fd4da96-c5ad-4f3c-bc82-4ed48fb1d7f4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:23.387286 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4fd4da96-c5ad-4f3c-bc82-4ed48fb1d7f4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.387760 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4fd4da96-c5ad-4f3c-bc82-4ed48fb1d7f4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:23.481598 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bdc2843b-d1ea-49f7-9a9a-fbdef0da16a8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:23.484366 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bdc2843b-d1ea-49f7-9a9a-fbdef0da16a8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:23.492772 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdc2843b-d1ea-49f7-9a9a-fbdef0da16a8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.493736 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdc2843b-d1ea-49f7-9a9a-fbdef0da16a8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:23.495701 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdc2843b-d1ea-49f7-9a9a-fbdef0da16a8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.496259 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdc2843b-d1ea-49f7-9a9a-fbdef0da16a8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:23.627544 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-4fd4da96-c5ad-4f3c-bc82-4ed48fb1d7f4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:23.637676 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-4fd4da96-c5ad-4f3c-bc82-4ed48fb1d7f4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:23.644765 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-4fd4da96-c5ad-4f3c-bc82-4ed48fb1d7f4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:23.646262 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4fd4da96-c5ad-4f3c-bc82-4ed48fb1d7f4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1744 microversion: 2.20 time: 0.271148 May 13 13:27:23.648210 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 142/302] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:23 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1744 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:23.665158 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bdc2843b-d1ea-49f7-9a9a-fbdef0da16a8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:23.672633 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bdc2843b-d1ea-49f7-9a9a-fbdef0da16a8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.197181 May 13 13:27:23.672835 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-dd940c8d-8f51-4dd6-ad01-d0ee56f2e006 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:23.673223 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 161/303] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:23 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:23.677511 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-dd940c8d-8f51-4dd6-ad01-d0ee56f2e006 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:23.688397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dd940c8d-8f51-4dd6-ad01-d0ee56f2e006 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.689298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dd940c8d-8f51-4dd6-ad01-d0ee56f2e006 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:23.690711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dd940c8d-8f51-4dd6-ad01-d0ee56f2e006 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.691762 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dd940c8d-8f51-4dd6-ad01-d0ee56f2e006 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:23.864055 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-dd940c8d-8f51-4dd6-ad01-d0ee56f2e006 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:23.872855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-dd940c8d-8f51-4dd6-ad01-d0ee56f2e006 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.209635 May 13 13:27:23.877808 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 143/304] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:23 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:23.934057 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-2dc3b465-6c40-4ae3-abb3-d86d44ac446d req-ddbadb89-3208-41b1-88e0-8205415d5752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebdcbcf7-a949-4081-9b20-5784ff43d5d9", "tag": "6d5de545-d4ec-4140-b705-2775719cf186"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:23.944350 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-2dc3b465-6c40-4ae3-abb3-d86d44ac446d req-ddbadb89-3208-41b1-88e0-8205415d5752 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.944801 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-2dc3b465-6c40-4ae3-abb3-d86d44ac446d req-ddbadb89-3208-41b1-88e0-8205415d5752 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:23.958423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-2dc3b465-6c40-4ae3-abb3-d86d44ac446d req-ddbadb89-3208-41b1-88e0-8205415d5752 service nova] Creating event network-changed:6d5de545-d4ec-4140-b705-2775719cf186 for instance ebdcbcf7-a949-4081-9b20-5784ff43d5d9 on hv-cinder-84159 May 13 13:27:23.963438 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-2dc3b465-6c40-4ae3-abb3-d86d44ac446d req-ddbadb89-3208-41b1-88e0-8205415d5752 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033178 May 13 13:27:23.964149 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 162/305] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:27:23.968817 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1bd26365-a940-4ec9-a458-a6cb56add003 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:23.969446 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1bd26365-a940-4ec9-a458-a6cb56add003 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:23.976232 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1bd26365-a940-4ec9-a458-a6cb56add003 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.976689 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1bd26365-a940-4ec9-a458-a6cb56add003 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:23.977554 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1bd26365-a940-4ec9-a458-a6cb56add003 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:23.978101 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1bd26365-a940-4ec9-a458-a6cb56add003 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:24.204224 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1bd26365-a940-4ec9-a458-a6cb56add003 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:24.212393 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1bd26365-a940-4ec9-a458-a6cb56add003 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.247494 May 13 13:27:24.213466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 144/306] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:23 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:24.290477 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3afd1abe-32c4-49ec-afb8-748d528bd4a2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:24.291794 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3afd1abe-32c4-49ec-afb8-748d528bd4a2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:24.298889 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3afd1abe-32c4-49ec-afb8-748d528bd4a2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:24.299355 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3afd1abe-32c4-49ec-afb8-748d528bd4a2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:24.300383 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3afd1abe-32c4-49ec-afb8-748d528bd4a2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:24.301041 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3afd1abe-32c4-49ec-afb8-748d528bd4a2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:24.561264 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3afd1abe-32c4-49ec-afb8-748d528bd4a2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:24.569799 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3afd1abe-32c4-49ec-afb8-748d528bd4a2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.283492 May 13 13:27:24.571257 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 163/307] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:24 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:24.666201 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-42661dd2-f7e6-4302-b99f-684a29eeccb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:24.666814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-42661dd2-f7e6-4302-b99f-684a29eeccb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:24.673618 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-42661dd2-f7e6-4302-b99f-684a29eeccb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:24.674182 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-42661dd2-f7e6-4302-b99f-684a29eeccb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:24.675052 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-42661dd2-f7e6-4302-b99f-684a29eeccb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:24.675591 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-42661dd2-f7e6-4302-b99f-684a29eeccb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:24.690222 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e9496025-0c55-4ea4-a038-606f22e19b91 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:24.691555 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e9496025-0c55-4ea4-a038-606f22e19b91 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:24.698451 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9496025-0c55-4ea4-a038-606f22e19b91 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:24.699423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9496025-0c55-4ea4-a038-606f22e19b91 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:24.700386 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9496025-0c55-4ea4-a038-606f22e19b91 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:24.701247 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9496025-0c55-4ea4-a038-606f22e19b91 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:24.848531 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e9496025-0c55-4ea4-a038-606f22e19b91 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:24.859775 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e9496025-0c55-4ea4-a038-606f22e19b91 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.173771 May 13 13:27:24.860854 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 164/308] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:24 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:24.890829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fc17058a-2463-4768-8585-8859ff6274ec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:24.891450 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fc17058a-2463-4768-8585-8859ff6274ec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:24.898054 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc17058a-2463-4768-8585-8859ff6274ec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:24.898796 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc17058a-2463-4768-8585-8859ff6274ec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:24.899818 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc17058a-2463-4768-8585-8859ff6274ec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:24.900637 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc17058a-2463-4768-8585-8859ff6274ec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.063109 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fc17058a-2463-4768-8585-8859ff6274ec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:25.074937 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fc17058a-2463-4768-8585-8859ff6274ec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.188870 May 13 13:27:25.075716 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 165/309] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:24 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:25.212792 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-42661dd2-f7e6-4302-b99f-684a29eeccb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:25.221364 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-42661dd2-f7e6-4302-b99f-684a29eeccb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:25.223237 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-42661dd2-f7e6-4302-b99f-684a29eeccb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:25.224710 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-42661dd2-f7e6-4302-b99f-684a29eeccb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1739 microversion: 2.20 time: 0.562490 May 13 13:27:25.230690 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6d034fb8-fd0e-4bcf-8660-21fb71ed5043 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:25.231657 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6d034fb8-fd0e-4bcf-8660-21fb71ed5043 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:25.249174 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 145/310] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:24 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1739 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:25.257546 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6d034fb8-fd0e-4bcf-8660-21fb71ed5043 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.257546 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6d034fb8-fd0e-4bcf-8660-21fb71ed5043 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.262378 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6d034fb8-fd0e-4bcf-8660-21fb71ed5043 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.262378 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6d034fb8-fd0e-4bcf-8660-21fb71ed5043 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.462520 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6d034fb8-fd0e-4bcf-8660-21fb71ed5043 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:25.517247 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6d034fb8-fd0e-4bcf-8660-21fb71ed5043 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.290448 May 13 13:27:25.520493 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 166/311] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:25 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:25.588556 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-744d6777-444a-40bd-8ff9-cb91199b7da6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:25.589130 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-744d6777-444a-40bd-8ff9-cb91199b7da6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:25.596534 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-744d6777-444a-40bd-8ff9-cb91199b7da6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.597291 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-744d6777-444a-40bd-8ff9-cb91199b7da6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.598901 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-744d6777-444a-40bd-8ff9-cb91199b7da6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.599559 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-744d6777-444a-40bd-8ff9-cb91199b7da6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.774029 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-00e70057-c06d-44da-b28c-4533a2a0df32 req-74dd212c-ef00-4a57-acd1-349215e0d004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89412841-b653-4a80-8cde-0c7a264a9c4c", "name": "network-vif-plugged", "status": "completed", "tag": "1a4cef43-4ad0-41f0-9857-11ea57340642"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:25.796373 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-00e70057-c06d-44da-b28c-4533a2a0df32 req-74dd212c-ef00-4a57-acd1-349215e0d004 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.797296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-00e70057-c06d-44da-b28c-4533a2a0df32 req-74dd212c-ef00-4a57-acd1-349215e0d004 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.812410 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-744d6777-444a-40bd-8ff9-cb91199b7da6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:25.819829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-00e70057-c06d-44da-b28c-4533a2a0df32 req-74dd212c-ef00-4a57-acd1-349215e0d004 service nova] Creating event network-vif-plugged:1a4cef43-4ad0-41f0-9857-11ea57340642 for instance 89412841-b653-4a80-8cde-0c7a264a9c4c on hv-cinder-84159 May 13 13:27:25.825549 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-744d6777-444a-40bd-8ff9-cb91199b7da6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.240037 May 13 13:27:25.827249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 146/312] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:25 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:25.829194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-00e70057-c06d-44da-b28c-4533a2a0df32 req-74dd212c-ef00-4a57-acd1-349215e0d004 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059038 May 13 13:27:25.829805 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 167/313] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:25.878682 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8472ce9b-94db-4f89-9d4f-aff6f6e3ece9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:25.878941 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8472ce9b-94db-4f89-9d4f-aff6f6e3ece9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:25.885202 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8472ce9b-94db-4f89-9d4f-aff6f6e3ece9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.886705 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8472ce9b-94db-4f89-9d4f-aff6f6e3ece9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:25.887543 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8472ce9b-94db-4f89-9d4f-aff6f6e3ece9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:25.888534 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8472ce9b-94db-4f89-9d4f-aff6f6e3ece9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.095776 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ec5fe271-43e2-4740-9cbd-b0ccb7dd3fec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:26.097950 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ec5fe271-43e2-4740-9cbd-b0ccb7dd3fec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:26.124967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ec5fe271-43e2-4740-9cbd-b0ccb7dd3fec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.126581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ec5fe271-43e2-4740-9cbd-b0ccb7dd3fec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.130554 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ec5fe271-43e2-4740-9cbd-b0ccb7dd3fec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.131913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ec5fe271-43e2-4740-9cbd-b0ccb7dd3fec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.146531 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-8472ce9b-94db-4f89-9d4f-aff6f6e3ece9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:26.155289 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8472ce9b-94db-4f89-9d4f-aff6f6e3ece9 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.282635 May 13 13:27:26.167655 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 147/314] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:25 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:26.273621 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0a6c101f-2e97-44ed-92d9-e4fd57b30c08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:26.274177 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0a6c101f-2e97-44ed-92d9-e4fd57b30c08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:26.284104 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0a6c101f-2e97-44ed-92d9-e4fd57b30c08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.284867 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0a6c101f-2e97-44ed-92d9-e4fd57b30c08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.288269 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0a6c101f-2e97-44ed-92d9-e4fd57b30c08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.289149 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0a6c101f-2e97-44ed-92d9-e4fd57b30c08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.429494 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ec5fe271-43e2-4740-9cbd-b0ccb7dd3fec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:26.447899 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ec5fe271-43e2-4740-9cbd-b0ccb7dd3fec tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.358665 May 13 13:27:26.458102 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 168/315] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:26 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:26.540315 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0af9ef3c-1218-4f97-b9f4-07d5fc5f3bd7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:26.542412 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0af9ef3c-1218-4f97-b9f4-07d5fc5f3bd7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:26.542846 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0a6c101f-2e97-44ed-92d9-e4fd57b30c08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:26.550965 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0af9ef3c-1218-4f97-b9f4-07d5fc5f3bd7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.551508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0af9ef3c-1218-4f97-b9f4-07d5fc5f3bd7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.552511 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0af9ef3c-1218-4f97-b9f4-07d5fc5f3bd7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.553106 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0a6c101f-2e97-44ed-92d9-e4fd57b30c08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:26.553374 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0af9ef3c-1218-4f97-b9f4-07d5fc5f3bd7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.561192 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0a6c101f-2e97-44ed-92d9-e4fd57b30c08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:26.562789 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0a6c101f-2e97-44ed-92d9-e4fd57b30c08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1739 microversion: 2.20 time: 0.311222 May 13 13:27:26.563860 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 148/316] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:26 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:27:26.751734 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0af9ef3c-1218-4f97-b9f4-07d5fc5f3bd7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:26.759602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0af9ef3c-1218-4f97-b9f4-07d5fc5f3bd7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.226769 May 13 13:27:26.760178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 169/317] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:26 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:26.844665 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a12bc0c3-8f82-4231-b765-9753f551bd9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:26.845236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a12bc0c3-8f82-4231-b765-9753f551bd9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:26.852657 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a12bc0c3-8f82-4231-b765-9753f551bd9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.853237 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a12bc0c3-8f82-4231-b765-9753f551bd9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:26.854142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a12bc0c3-8f82-4231-b765-9753f551bd9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:26.854824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a12bc0c3-8f82-4231-b765-9753f551bd9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.003144 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a12bc0c3-8f82-4231-b765-9753f551bd9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:27.010874 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a12bc0c3-8f82-4231-b765-9753f551bd9f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.170731 May 13 13:27:27.018189 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 149/318] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:26 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:27.174439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d2d8cb9e-7168-4953-b2dd-8ce567c5c83d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:27.175074 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d2d8cb9e-7168-4953-b2dd-8ce567c5c83d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:27.182425 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d2d8cb9e-7168-4953-b2dd-8ce567c5c83d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.183372 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d2d8cb9e-7168-4953-b2dd-8ce567c5c83d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.184428 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d2d8cb9e-7168-4953-b2dd-8ce567c5c83d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.185086 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d2d8cb9e-7168-4953-b2dd-8ce567c5c83d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.331427 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d2d8cb9e-7168-4953-b2dd-8ce567c5c83d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:27.339289 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d2d8cb9e-7168-4953-b2dd-8ce567c5c83d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.168661 May 13 13:27:27.340498 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 170/319] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:27 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:27.477903 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a6a31f4e-1e54-4633-90b8-dbcc7f5aa7cb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:27.477903 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a6a31f4e-1e54-4633-90b8-dbcc7f5aa7cb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:27.481316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a6a31f4e-1e54-4633-90b8-dbcc7f5aa7cb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.481884 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a6a31f4e-1e54-4633-90b8-dbcc7f5aa7cb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.483286 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a6a31f4e-1e54-4633-90b8-dbcc7f5aa7cb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.483801 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a6a31f4e-1e54-4633-90b8-dbcc7f5aa7cb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.591380 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7a8d8fd8-c3b0-4a5b-8b40-9ce6d6301d39 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:27.592535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7a8d8fd8-c3b0-4a5b-8b40-9ce6d6301d39 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:27.604742 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7a8d8fd8-c3b0-4a5b-8b40-9ce6d6301d39 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.605502 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7a8d8fd8-c3b0-4a5b-8b40-9ce6d6301d39 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.606582 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7a8d8fd8-c3b0-4a5b-8b40-9ce6d6301d39 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.607029 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7a8d8fd8-c3b0-4a5b-8b40-9ce6d6301d39 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.649676 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a6a31f4e-1e54-4633-90b8-dbcc7f5aa7cb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:27.664907 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a6a31f4e-1e54-4633-90b8-dbcc7f5aa7cb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.200427 May 13 13:27:27.665707 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 150/320] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:27 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:27.776904 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-dea071ae-3b01-4afc-9cba-08366814923b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:27.777629 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-dea071ae-3b01-4afc-9cba-08366814923b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:27.786234 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7a8d8fd8-c3b0-4a5b-8b40-9ce6d6301d39 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:27.790471 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dea071ae-3b01-4afc-9cba-08366814923b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.790941 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dea071ae-3b01-4afc-9cba-08366814923b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.791742 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dea071ae-3b01-4afc-9cba-08366814923b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.792248 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dea071ae-3b01-4afc-9cba-08366814923b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.800227 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7a8d8fd8-c3b0-4a5b-8b40-9ce6d6301d39 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:27.801810 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7a8d8fd8-c3b0-4a5b-8b40-9ce6d6301d39 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:27.812721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7a8d8fd8-c3b0-4a5b-8b40-9ce6d6301d39 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1739 microversion: 2.20 time: 0.222870 May 13 13:27:27.812721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 171/321] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:27 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:27.876196 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-385cdf8f-e29e-412d-930e-0a2354210369 req-4de60455-f9f1-47fa-8e91-ff491cd898e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8063f90-dde5-4697-b772-2d63abfae0ec", "name": "network-vif-plugged", "status": "completed", "tag": "ca45ea26-ebef-4cf1-b670-b108bd4e54d4"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:27.887586 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-385cdf8f-e29e-412d-930e-0a2354210369 req-4de60455-f9f1-47fa-8e91-ff491cd898e5 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:27.888123 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-385cdf8f-e29e-412d-930e-0a2354210369 req-4de60455-f9f1-47fa-8e91-ff491cd898e5 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:27.902306 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-385cdf8f-e29e-412d-930e-0a2354210369 req-4de60455-f9f1-47fa-8e91-ff491cd898e5 service nova] Creating event network-vif-plugged:ca45ea26-ebef-4cf1-b670-b108bd4e54d4 for instance c8063f90-dde5-4697-b772-2d63abfae0ec on hv-cinder-84159 May 13 13:27:27.920347 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-385cdf8f-e29e-412d-930e-0a2354210369 req-4de60455-f9f1-47fa-8e91-ff491cd898e5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049214 May 13 13:27:27.921266 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 172/322] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:27:27.967726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-dea071ae-3b01-4afc-9cba-08366814923b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:27.975743 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-dea071ae-3b01-4afc-9cba-08366814923b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.202466 May 13 13:27:27.976621 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 151/323] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:27 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:28.028343 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0d8877bc-fea9-4774-9336-9d92ecbe3980 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:28.029060 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0d8877bc-fea9-4774-9336-9d92ecbe3980 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:28.036240 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0d8877bc-fea9-4774-9336-9d92ecbe3980 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.036692 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0d8877bc-fea9-4774-9336-9d92ecbe3980 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.037509 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0d8877bc-fea9-4774-9336-9d92ecbe3980 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.037967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0d8877bc-fea9-4774-9336-9d92ecbe3980 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.190634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0d8877bc-fea9-4774-9336-9d92ecbe3980 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:28.197944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0d8877bc-fea9-4774-9336-9d92ecbe3980 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.173903 May 13 13:27:28.198516 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 173/324] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:28 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:28.356538 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-00b679ec-31cf-40c3-8317-74e5fc800332 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:28.357154 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-00b679ec-31cf-40c3-8317-74e5fc800332 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:28.364087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-00b679ec-31cf-40c3-8317-74e5fc800332 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.364544 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-00b679ec-31cf-40c3-8317-74e5fc800332 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.365318 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-00b679ec-31cf-40c3-8317-74e5fc800332 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.365766 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-00b679ec-31cf-40c3-8317-74e5fc800332 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.530904 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-00b679ec-31cf-40c3-8317-74e5fc800332 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:28.538328 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-00b679ec-31cf-40c3-8317-74e5fc800332 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.185705 May 13 13:27:28.538893 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 152/325] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:28 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:28.689756 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-76ee0eea-bdd4-459f-8433-15f884dac7e7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:28.691033 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-76ee0eea-bdd4-459f-8433-15f884dac7e7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:28.697640 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76ee0eea-bdd4-459f-8433-15f884dac7e7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.698133 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76ee0eea-bdd4-459f-8433-15f884dac7e7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.699173 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76ee0eea-bdd4-459f-8433-15f884dac7e7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.699809 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76ee0eea-bdd4-459f-8433-15f884dac7e7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.824118 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c096a15d-2bfa-4938-a846-f5b965441f51 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:28.825022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c096a15d-2bfa-4938-a846-f5b965441f51 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:28.839647 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c096a15d-2bfa-4938-a846-f5b965441f51 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.840252 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c096a15d-2bfa-4938-a846-f5b965441f51 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.841147 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c096a15d-2bfa-4938-a846-f5b965441f51 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:28.841651 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c096a15d-2bfa-4938-a846-f5b965441f51 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:28.846759 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-76ee0eea-bdd4-459f-8433-15f884dac7e7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:28.855668 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-76ee0eea-bdd4-459f-8433-15f884dac7e7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.170980 May 13 13:27:28.856817 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 174/326] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:28 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:28.993645 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-699c568b-7736-4ab8-ab99-9fa8b4c1aa8b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:28.994614 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-699c568b-7736-4ab8-ab99-9fa8b4c1aa8b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:29.002508 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-699c568b-7736-4ab8-ab99-9fa8b4c1aa8b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:29.003355 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-699c568b-7736-4ab8-ab99-9fa8b4c1aa8b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:29.004364 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-699c568b-7736-4ab8-ab99-9fa8b4c1aa8b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:29.005024 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-699c568b-7736-4ab8-ab99-9fa8b4c1aa8b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:29.010540 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c096a15d-2bfa-4938-a846-f5b965441f51 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:29.019108 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c096a15d-2bfa-4938-a846-f5b965441f51 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:29.020598 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c096a15d-2bfa-4938-a846-f5b965441f51 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:29.024432 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c096a15d-2bfa-4938-a846-f5b965441f51 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1739 microversion: 2.20 time: 0.204481 May 13 13:27:29.036470 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 153/327] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:28 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:27:29.163070 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-699c568b-7736-4ab8-ab99-9fa8b4c1aa8b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:29.171464 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-699c568b-7736-4ab8-ab99-9fa8b4c1aa8b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.182618 May 13 13:27:29.172439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 175/328] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:28 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:29.215354 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e85454e3-1d8e-4341-99d4-a83b07f2decc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:29.216014 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e85454e3-1d8e-4341-99d4-a83b07f2decc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:29.222370 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e85454e3-1d8e-4341-99d4-a83b07f2decc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:29.222913 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e85454e3-1d8e-4341-99d4-a83b07f2decc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:29.224130 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e85454e3-1d8e-4341-99d4-a83b07f2decc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:29.224393 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e85454e3-1d8e-4341-99d4-a83b07f2decc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:29.377076 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e85454e3-1d8e-4341-99d4-a83b07f2decc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:29.385627 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e85454e3-1d8e-4341-99d4-a83b07f2decc tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.174153 May 13 13:27:29.386233 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 154/329] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:29 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:29.556414 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-37ed114e-8b5d-417c-adf9-62ae27126d26 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:29.557036 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-37ed114e-8b5d-417c-adf9-62ae27126d26 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:29.564798 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37ed114e-8b5d-417c-adf9-62ae27126d26 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:29.565256 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37ed114e-8b5d-417c-adf9-62ae27126d26 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:29.566079 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37ed114e-8b5d-417c-adf9-62ae27126d26 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:29.566525 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37ed114e-8b5d-417c-adf9-62ae27126d26 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:29.716847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-37ed114e-8b5d-417c-adf9-62ae27126d26 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:29.727113 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-37ed114e-8b5d-417c-adf9-62ae27126d26 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.174347 May 13 13:27:29.727745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 176/330] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:29 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:29.872425 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-cea80dc9-d87a-4f97-a59c-287140a3f6c0 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:29.872950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-cea80dc9-d87a-4f97-a59c-287140a3f6c0 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:29.879548 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cea80dc9-d87a-4f97-a59c-287140a3f6c0 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:29.879997 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cea80dc9-d87a-4f97-a59c-287140a3f6c0 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:29.880727 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cea80dc9-d87a-4f97-a59c-287140a3f6c0 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:29.881179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cea80dc9-d87a-4f97-a59c-287140a3f6c0 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.044059 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9fb6ab36-60fc-4c60-9925-0d4203613f08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:30.047444 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9fb6ab36-60fc-4c60-9925-0d4203613f08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:30.048279 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-cea80dc9-d87a-4f97-a59c-287140a3f6c0 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:30.056396 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9fb6ab36-60fc-4c60-9925-0d4203613f08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:30.056722 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-cea80dc9-d87a-4f97-a59c-287140a3f6c0 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.188175 May 13 13:27:30.057498 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 155/331] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:29 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:30.062920 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9fb6ab36-60fc-4c60-9925-0d4203613f08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.065387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9fb6ab36-60fc-4c60-9925-0d4203613f08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:30.066374 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9fb6ab36-60fc-4c60-9925-0d4203613f08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.188532 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-29ff9fc0-aac2-4b8e-aada-c17bdf27d9e1 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:30.189684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-29ff9fc0-aac2-4b8e-aada-c17bdf27d9e1 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:30.200955 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-29ff9fc0-aac2-4b8e-aada-c17bdf27d9e1 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:30.201779 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-29ff9fc0-aac2-4b8e-aada-c17bdf27d9e1 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.202995 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-29ff9fc0-aac2-4b8e-aada-c17bdf27d9e1 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:30.203660 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-29ff9fc0-aac2-4b8e-aada-c17bdf27d9e1 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.254173 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9fb6ab36-60fc-4c60-9925-0d4203613f08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:30.278422 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9fb6ab36-60fc-4c60-9925-0d4203613f08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:30.288620 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9fb6ab36-60fc-4c60-9925-0d4203613f08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:30.289966 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9fb6ab36-60fc-4c60-9925-0d4203613f08 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1739 microversion: 2.20 time: 0.250468 May 13 13:27:30.291136 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 177/332] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:30 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:27:30.403367 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-49a2656d-5d4e-49b2-a2bb-49ec4083d2b3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:30.404146 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-49a2656d-5d4e-49b2-a2bb-49ec4083d2b3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:30.411998 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49a2656d-5d4e-49b2-a2bb-49ec4083d2b3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:30.412599 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49a2656d-5d4e-49b2-a2bb-49ec4083d2b3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.413448 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49a2656d-5d4e-49b2-a2bb-49ec4083d2b3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:30.413927 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49a2656d-5d4e-49b2-a2bb-49ec4083d2b3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.458845 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-29ff9fc0-aac2-4b8e-aada-c17bdf27d9e1 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:30.467496 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-29ff9fc0-aac2-4b8e-aada-c17bdf27d9e1 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.282887 May 13 13:27:30.472687 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 156/333] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:30 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:30.617652 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-49a2656d-5d4e-49b2-a2bb-49ec4083d2b3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:30.626749 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-49a2656d-5d4e-49b2-a2bb-49ec4083d2b3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.227618 May 13 13:27:30.627887 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 178/334] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:30 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:30.684568 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-25aa037f-a881-4c2a-9279-344dd4599dc8 req-5af0515a-906a-4254-bf01-66f3853406fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e0eae6-6c5f-446e-a5c3-bfccf382c353", "name": "network-vif-plugged", "status": "completed", "tag": "517c54c5-bfa9-4ac4-b0ba-9b4f1df9e8ad"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:30.694059 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-25aa037f-a881-4c2a-9279-344dd4599dc8 req-5af0515a-906a-4254-bf01-66f3853406fc service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:30.695464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-25aa037f-a881-4c2a-9279-344dd4599dc8 req-5af0515a-906a-4254-bf01-66f3853406fc service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.708604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-25aa037f-a881-4c2a-9279-344dd4599dc8 req-5af0515a-906a-4254-bf01-66f3853406fc service nova] Creating event network-vif-plugged:517c54c5-bfa9-4ac4-b0ba-9b4f1df9e8ad for instance 48e0eae6-6c5f-446e-a5c3-bfccf382c353 on hv-cinder-84159 May 13 13:27:30.714654 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-25aa037f-a881-4c2a-9279-344dd4599dc8 req-5af0515a-906a-4254-bf01-66f3853406fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034044 May 13 13:27:30.718821 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 157/335] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:27:30.743931 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7e8cf1a6-0140-4282-b2a9-072a0c7a888d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:30.745275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7e8cf1a6-0140-4282-b2a9-072a0c7a888d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:30.752635 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e8cf1a6-0140-4282-b2a9-072a0c7a888d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:30.753449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e8cf1a6-0140-4282-b2a9-072a0c7a888d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.754501 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e8cf1a6-0140-4282-b2a9-072a0c7a888d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:30.755157 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7e8cf1a6-0140-4282-b2a9-072a0c7a888d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:30.939970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7e8cf1a6-0140-4282-b2a9-072a0c7a888d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:30.948606 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7e8cf1a6-0140-4282-b2a9-072a0c7a888d tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.209037 May 13 13:27:30.958428 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 179/336] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:30 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:31.075821 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-485ed86d-5aca-4e5a-a54c-22880c071d03 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:31.076631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-485ed86d-5aca-4e5a-a54c-22880c071d03 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:31.083631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-485ed86d-5aca-4e5a-a54c-22880c071d03 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.085123 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-485ed86d-5aca-4e5a-a54c-22880c071d03 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.086202 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-485ed86d-5aca-4e5a-a54c-22880c071d03 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.086647 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-485ed86d-5aca-4e5a-a54c-22880c071d03 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.260049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-485ed86d-5aca-4e5a-a54c-22880c071d03 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:31.268653 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-485ed86d-5aca-4e5a-a54c-22880c071d03 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.197925 May 13 13:27:31.270041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 158/337] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:31 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:31.310398 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3fff2e89-f378-4d77-89c5-21c75bca3a18 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:31.310398 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3fff2e89-f378-4d77-89c5-21c75bca3a18 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:31.320422 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fff2e89-f378-4d77-89c5-21c75bca3a18 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.320910 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fff2e89-f378-4d77-89c5-21c75bca3a18 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.321696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fff2e89-f378-4d77-89c5-21c75bca3a18 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.322157 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fff2e89-f378-4d77-89c5-21c75bca3a18 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.471486 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3fff2e89-f378-4d77-89c5-21c75bca3a18 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:31.483504 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3fff2e89-f378-4d77-89c5-21c75bca3a18 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:31.485965 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3fff2e89-f378-4d77-89c5-21c75bca3a18 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:31.491713 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3fff2e89-f378-4d77-89c5-21c75bca3a18 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1739 microversion: 2.20 time: 0.182526 May 13 13:27:31.491713 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 180/338] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:31 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:31.491998 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ab849c95-a986-48a6-9d75-27588f3ddf42 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:31.491998 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ab849c95-a986-48a6-9d75-27588f3ddf42 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:31.499286 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ab849c95-a986-48a6-9d75-27588f3ddf42 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.499745 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ab849c95-a986-48a6-9d75-27588f3ddf42 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.500653 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ab849c95-a986-48a6-9d75-27588f3ddf42 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.501096 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ab849c95-a986-48a6-9d75-27588f3ddf42 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.644020 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a34b1840-53a2-43b6-8afb-9f29f915f1f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:31.645075 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a34b1840-53a2-43b6-8afb-9f29f915f1f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:31.651262 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a34b1840-53a2-43b6-8afb-9f29f915f1f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.651826 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a34b1840-53a2-43b6-8afb-9f29f915f1f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.652723 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a34b1840-53a2-43b6-8afb-9f29f915f1f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.653275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a34b1840-53a2-43b6-8afb-9f29f915f1f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.661966 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ab849c95-a986-48a6-9d75-27588f3ddf42 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:31.669571 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ab849c95-a986-48a6-9d75-27588f3ddf42 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.183151 May 13 13:27:31.670364 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 159/339] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:31 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:31.955108 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a34b1840-53a2-43b6-8afb-9f29f915f1f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:31.955108 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a34b1840-53a2-43b6-8afb-9f29f915f1f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.168217 May 13 13:27:31.955108 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 181/340] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:31 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:31.965952 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-609f2b4b-9650-4107-9986-2312e58bfd7a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:31.966559 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-609f2b4b-9650-4107-9986-2312e58bfd7a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:31.972868 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-609f2b4b-9650-4107-9986-2312e58bfd7a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.973493 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-609f2b4b-9650-4107-9986-2312e58bfd7a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:31.974419 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-609f2b4b-9650-4107-9986-2312e58bfd7a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:31.974840 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-609f2b4b-9650-4107-9986-2312e58bfd7a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:32.118282 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-609f2b4b-9650-4107-9986-2312e58bfd7a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:32.126283 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-609f2b4b-9650-4107-9986-2312e58bfd7a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.164179 May 13 13:27:32.126886 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 160/341] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:31 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:32.285867 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fc3038e7-5877-4974-a8c4-d1d442151f0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:32.286427 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fc3038e7-5877-4974-a8c4-d1d442151f0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:32.292987 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc3038e7-5877-4974-a8c4-d1d442151f0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:32.293446 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc3038e7-5877-4974-a8c4-d1d442151f0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:32.294292 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc3038e7-5877-4974-a8c4-d1d442151f0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:32.294736 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc3038e7-5877-4974-a8c4-d1d442151f0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:32.429038 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fc3038e7-5877-4974-a8c4-d1d442151f0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:32.437736 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fc3038e7-5877-4974-a8c4-d1d442151f0c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.155635 May 13 13:27:32.438970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 182/342] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:32 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:32.507026 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a3f2a62a-7607-441f-8f9a-5324d3b33be0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:32.507795 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a3f2a62a-7607-441f-8f9a-5324d3b33be0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:32.514601 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a3f2a62a-7607-441f-8f9a-5324d3b33be0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:32.515358 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a3f2a62a-7607-441f-8f9a-5324d3b33be0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:32.516369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a3f2a62a-7607-441f-8f9a-5324d3b33be0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:32.516913 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a3f2a62a-7607-441f-8f9a-5324d3b33be0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:32.657202 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a3f2a62a-7607-441f-8f9a-5324d3b33be0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:32.673348 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a3f2a62a-7607-441f-8f9a-5324d3b33be0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:32.677384 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a3f2a62a-7607-441f-8f9a-5324d3b33be0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:32.680172 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a3f2a62a-7607-441f-8f9a-5324d3b33be0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1739 microversion: 2.20 time: 0.179512 May 13 13:27:32.682550 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 161/343] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:32 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:32.697174 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fad55eb0-2203-42ae-9603-133b744ee077 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:32.698093 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fad55eb0-2203-42ae-9603-133b744ee077 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:32.714447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fad55eb0-2203-42ae-9603-133b744ee077 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:32.715063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fad55eb0-2203-42ae-9603-133b744ee077 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:32.715875 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fad55eb0-2203-42ae-9603-133b744ee077 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:32.716372 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fad55eb0-2203-42ae-9603-133b744ee077 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:32.893558 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fad55eb0-2203-42ae-9603-133b744ee077 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:32.901714 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fad55eb0-2203-42ae-9603-133b744ee077 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.208326 May 13 13:27:32.910168 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 183/344] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:32 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:32.930095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b9fcd3c8-a86e-4854-898b-a382a09192a5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:32.936478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b9fcd3c8-a86e-4854-898b-a382a09192a5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:32.938983 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b9fcd3c8-a86e-4854-898b-a382a09192a5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:32.939640 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b9fcd3c8-a86e-4854-898b-a382a09192a5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:32.940628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b9fcd3c8-a86e-4854-898b-a382a09192a5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:32.941229 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b9fcd3c8-a86e-4854-898b-a382a09192a5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:33.109742 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b9fcd3c8-a86e-4854-898b-a382a09192a5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:33.119152 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b9fcd3c8-a86e-4854-898b-a382a09192a5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.192824 May 13 13:27:33.128591 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 162/345] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:32 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:33.147309 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e063b97b-68ff-4762-9e58-fa5ef0b2f44a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:33.147309 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e063b97b-68ff-4762-9e58-fa5ef0b2f44a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:33.156634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e063b97b-68ff-4762-9e58-fa5ef0b2f44a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:33.156634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e063b97b-68ff-4762-9e58-fa5ef0b2f44a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:33.156634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e063b97b-68ff-4762-9e58-fa5ef0b2f44a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:33.156634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e063b97b-68ff-4762-9e58-fa5ef0b2f44a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:33.307314 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e063b97b-68ff-4762-9e58-fa5ef0b2f44a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:33.316010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e063b97b-68ff-4762-9e58-fa5ef0b2f44a tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.174725 May 13 13:27:33.328790 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 184/346] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:33 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:33.456563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-56e7e86a-7488-45fe-8906-6ebbdbc3216a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:33.457123 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-56e7e86a-7488-45fe-8906-6ebbdbc3216a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:33.463784 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-56e7e86a-7488-45fe-8906-6ebbdbc3216a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:33.464362 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-56e7e86a-7488-45fe-8906-6ebbdbc3216a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:33.465486 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-56e7e86a-7488-45fe-8906-6ebbdbc3216a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:33.466047 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-56e7e86a-7488-45fe-8906-6ebbdbc3216a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:33.616664 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-56e7e86a-7488-45fe-8906-6ebbdbc3216a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:33.627951 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-56e7e86a-7488-45fe-8906-6ebbdbc3216a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.176339 May 13 13:27:33.628671 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 163/347] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:33 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:33.699616 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1700c994-9fe2-475d-a3c0-035b1c36a22b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:33.700523 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1700c994-9fe2-475d-a3c0-035b1c36a22b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:33.706682 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1700c994-9fe2-475d-a3c0-035b1c36a22b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:33.707069 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1700c994-9fe2-475d-a3c0-035b1c36a22b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:33.707941 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1700c994-9fe2-475d-a3c0-035b1c36a22b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:33.708382 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1700c994-9fe2-475d-a3c0-035b1c36a22b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:33.857667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1700c994-9fe2-475d-a3c0-035b1c36a22b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:33.866484 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1700c994-9fe2-475d-a3c0-035b1c36a22b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:33.868666 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1700c994-9fe2-475d-a3c0-035b1c36a22b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:33.870044 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1700c994-9fe2-475d-a3c0-035b1c36a22b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1739 microversion: 2.20 time: 0.174577 May 13 13:27:33.872815 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 185/348] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:33 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:33.918562 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c706ac95-79d5-443f-b5db-2ffe5abebdfb tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:33.919475 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c706ac95-79d5-443f-b5db-2ffe5abebdfb tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:33.926576 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c706ac95-79d5-443f-b5db-2ffe5abebdfb tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:33.927323 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c706ac95-79d5-443f-b5db-2ffe5abebdfb tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:33.928294 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c706ac95-79d5-443f-b5db-2ffe5abebdfb tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:33.928743 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c706ac95-79d5-443f-b5db-2ffe5abebdfb tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:34.073771 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c706ac95-79d5-443f-b5db-2ffe5abebdfb tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:34.081829 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c706ac95-79d5-443f-b5db-2ffe5abebdfb tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.167041 May 13 13:27:34.082612 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 164/349] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:33 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:34.139838 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ac447e92-b405-4d57-bc0f-d6d32d458080 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:34.140453 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ac447e92-b405-4d57-bc0f-d6d32d458080 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:34.151127 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ac447e92-b405-4d57-bc0f-d6d32d458080 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:34.152300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ac447e92-b405-4d57-bc0f-d6d32d458080 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:34.153259 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ac447e92-b405-4d57-bc0f-d6d32d458080 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:34.153884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ac447e92-b405-4d57-bc0f-d6d32d458080 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:34.303437 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ac447e92-b405-4d57-bc0f-d6d32d458080 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:34.315729 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ac447e92-b405-4d57-bc0f-d6d32d458080 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1371 microversion: 2.1 time: 0.179615 May 13 13:27:34.316307 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 186/350] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:34 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:34.334709 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-af15c55a-a0af-4830-b716-2654d7b8f005 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:34.335500 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-af15c55a-a0af-4830-b716-2654d7b8f005 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:34.342420 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-af15c55a-a0af-4830-b716-2654d7b8f005 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:34.349184 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-af15c55a-a0af-4830-b716-2654d7b8f005 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:34.349184 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-af15c55a-a0af-4830-b716-2654d7b8f005 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:34.349184 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-af15c55a-a0af-4830-b716-2654d7b8f005 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:34.492378 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-af15c55a-a0af-4830-b716-2654d7b8f005 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:34.503484 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-af15c55a-a0af-4830-b716-2654d7b8f005 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.172807 May 13 13:27:34.504371 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 165/351] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:34 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:34.645581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-398c6127-19ad-4a57-b479-a9175ed90876 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:34.646307 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-398c6127-19ad-4a57-b479-a9175ed90876 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:34.652836 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-398c6127-19ad-4a57-b479-a9175ed90876 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:34.653285 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-398c6127-19ad-4a57-b479-a9175ed90876 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:34.654209 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-398c6127-19ad-4a57-b479-a9175ed90876 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:34.655235 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-398c6127-19ad-4a57-b479-a9175ed90876 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:34.805458 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-398c6127-19ad-4a57-b479-a9175ed90876 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:34.819046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-398c6127-19ad-4a57-b479-a9175ed90876 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.177024 May 13 13:27:34.819264 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 187/352] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:34 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:34.894827 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2fa2770e-ab72-44da-bfec-787ecb8869b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:34.895445 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2fa2770e-ab72-44da-bfec-787ecb8869b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:34.902864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2fa2770e-ab72-44da-bfec-787ecb8869b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:34.903555 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2fa2770e-ab72-44da-bfec-787ecb8869b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:34.905105 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2fa2770e-ab72-44da-bfec-787ecb8869b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:34.905717 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2fa2770e-ab72-44da-bfec-787ecb8869b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.100988 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-45f3f5d5-b195-44eb-aaab-e707c2589502 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:35.101996 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-45f3f5d5-b195-44eb-aaab-e707c2589502 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:35.110636 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-45f3f5d5-b195-44eb-aaab-e707c2589502 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.111456 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-45f3f5d5-b195-44eb-aaab-e707c2589502 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.112475 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-45f3f5d5-b195-44eb-aaab-e707c2589502 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.113123 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-45f3f5d5-b195-44eb-aaab-e707c2589502 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.116172 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2fa2770e-ab72-44da-bfec-787ecb8869b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:35.135765 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2fa2770e-ab72-44da-bfec-787ecb8869b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:35.137825 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2fa2770e-ab72-44da-bfec-787ecb8869b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:35.139779 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2fa2770e-ab72-44da-bfec-787ecb8869b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1739 microversion: 2.20 time: 0.249148 May 13 13:27:35.150778 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 166/353] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:34 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:35.267804 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-45f3f5d5-b195-44eb-aaab-e707c2589502 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:35.275249 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-45f3f5d5-b195-44eb-aaab-e707c2589502 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.178969 May 13 13:27:35.275820 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 188/354] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:35 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:35.333576 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ec2f3a06-0773-4cfe-8350-f24ff9012b97 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:35.334217 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ec2f3a06-0773-4cfe-8350-f24ff9012b97 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:35.340149 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ec2f3a06-0773-4cfe-8350-f24ff9012b97 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.340734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ec2f3a06-0773-4cfe-8350-f24ff9012b97 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.341379 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ec2f3a06-0773-4cfe-8350-f24ff9012b97 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.341864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ec2f3a06-0773-4cfe-8350-f24ff9012b97 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.481745 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ec2f3a06-0773-4cfe-8350-f24ff9012b97 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:35.489113 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ec2f3a06-0773-4cfe-8350-f24ff9012b97 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1564 microversion: 2.1 time: 0.159338 May 13 13:27:35.489683 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 167/355] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:35 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:35.505822 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-054e0230-2392-40ce-aa22-7e1e4330f8ef tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:35.506323 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-054e0230-2392-40ce-aa22-7e1e4330f8ef tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:35.512137 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-054e0230-2392-40ce-aa22-7e1e4330f8ef tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.512606 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-054e0230-2392-40ce-aa22-7e1e4330f8ef tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.513386 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-054e0230-2392-40ce-aa22-7e1e4330f8ef tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.513881 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-054e0230-2392-40ce-aa22-7e1e4330f8ef tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.520801 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-30bfcf02-42ea-450c-8b12-6bba77dbd4e6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:35.521468 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-30bfcf02-42ea-450c-8b12-6bba77dbd4e6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:35.527243 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-30bfcf02-42ea-450c-8b12-6bba77dbd4e6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.527690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-30bfcf02-42ea-450c-8b12-6bba77dbd4e6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.544373 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-30bfcf02-42ea-450c-8b12-6bba77dbd4e6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.544820 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-30bfcf02-42ea-450c-8b12-6bba77dbd4e6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.592583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-054e0230-2392-40ce-aa22-7e1e4330f8ef tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090571 May 13 13:27:35.593180 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 189/356] 10.222.0.25 () {58 vars in 1274 bytes} [Fri May 13 13:27:35 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:35.684613 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-30bfcf02-42ea-450c-8b12-6bba77dbd4e6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:35.696803 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-30bfcf02-42ea-450c-8b12-6bba77dbd4e6 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.179725 May 13 13:27:35.697597 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 168/357] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:35 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:35.836052 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1849980c-a134-40cc-aeef-553e77cbd0e1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:35.836702 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1849980c-a134-40cc-aeef-553e77cbd0e1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:35.842957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1849980c-a134-40cc-aeef-553e77cbd0e1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.843851 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1849980c-a134-40cc-aeef-553e77cbd0e1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:35.847150 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1849980c-a134-40cc-aeef-553e77cbd0e1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:35.847616 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1849980c-a134-40cc-aeef-553e77cbd0e1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.160609 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-87192a16-47b7-4936-bc62-cc633ab9d7a2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:36.161629 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-87192a16-47b7-4936-bc62-cc633ab9d7a2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:36.178547 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-87192a16-47b7-4936-bc62-cc633ab9d7a2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.179135 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-87192a16-47b7-4936-bc62-cc633ab9d7a2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.181021 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-87192a16-47b7-4936-bc62-cc633ab9d7a2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.181811 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-87192a16-47b7-4936-bc62-cc633ab9d7a2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.372318 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-87192a16-47b7-4936-bc62-cc633ab9d7a2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:36.383307 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-87192a16-47b7-4936-bc62-cc633ab9d7a2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:36.385291 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-87192a16-47b7-4936-bc62-cc633ab9d7a2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:36.388039 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-87192a16-47b7-4936-bc62-cc633ab9d7a2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1739 microversion: 2.20 time: 0.231249 May 13 13:27:36.389083 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 169/358] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:36 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:36.395270 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e252de0a-fe00-4835-b5e2-75cd11c6765f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:36.395888 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e252de0a-fe00-4835-b5e2-75cd11c6765f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:36.403161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e252de0a-fe00-4835-b5e2-75cd11c6765f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.403398 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e252de0a-fe00-4835-b5e2-75cd11c6765f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.404896 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e252de0a-fe00-4835-b5e2-75cd11c6765f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.405358 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e252de0a-fe00-4835-b5e2-75cd11c6765f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.486377 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1849980c-a134-40cc-aeef-553e77cbd0e1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:36.494986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1849980c-a134-40cc-aeef-553e77cbd0e1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1723 microversion: 2.1 time: 0.663015 May 13 13:27:36.504566 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 190/359] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:35 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1723 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:36.563693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e252de0a-fe00-4835-b5e2-75cd11c6765f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:36.572023 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e252de0a-fe00-4835-b5e2-75cd11c6765f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.180848 May 13 13:27:36.572785 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 170/360] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:36 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:36.716458 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c7ffced9-3b2f-4a40-8565-0f69df19a165 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:36.722138 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c7ffced9-3b2f-4a40-8565-0f69df19a165 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:36.730256 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c7ffced9-3b2f-4a40-8565-0f69df19a165 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.730720 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c7ffced9-3b2f-4a40-8565-0f69df19a165 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.731550 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c7ffced9-3b2f-4a40-8565-0f69df19a165 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.731996 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c7ffced9-3b2f-4a40-8565-0f69df19a165 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.778598 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-9a3264e0-7474-4ff8-a63c-858912f4a8ff req-ab9f15b8-7bfe-427b-8e32-3cab91291667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebdcbcf7-a949-4081-9b20-5784ff43d5d9", "name": "network-vif-plugged", "status": "completed", "tag": "6d5de545-d4ec-4140-b705-2775719cf186"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:36.791449 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-9a3264e0-7474-4ff8-a63c-858912f4a8ff req-ab9f15b8-7bfe-427b-8e32-3cab91291667 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:36.791921 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-9a3264e0-7474-4ff8-a63c-858912f4a8ff req-ab9f15b8-7bfe-427b-8e32-3cab91291667 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:36.803291 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-9a3264e0-7474-4ff8-a63c-858912f4a8ff req-ab9f15b8-7bfe-427b-8e32-3cab91291667 service nova] Creating event network-vif-plugged:6d5de545-d4ec-4140-b705-2775719cf186 for instance ebdcbcf7-a949-4081-9b20-5784ff43d5d9 on hv-cinder-84159 May 13 13:27:36.809197 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-9a3264e0-7474-4ff8-a63c-858912f4a8ff req-ab9f15b8-7bfe-427b-8e32-3cab91291667 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034322 May 13 13:27:36.809542 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 171/361] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:27:36.926427 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c7ffced9-3b2f-4a40-8565-0f69df19a165 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:36.934202 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c7ffced9-3b2f-4a40-8565-0f69df19a165 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.223348 May 13 13:27:36.934776 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 191/362] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:36 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:37.143349 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-9c766246-6642-4d60-920a-8a83c416056d req-17e328c6-abdf-4c0d-b133-bfb08177469e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8063f90-dde5-4697-b772-2d63abfae0ec", "tag": "ca45ea26-ebef-4cf1-b670-b108bd4e54d4"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:37.153376 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-9c766246-6642-4d60-920a-8a83c416056d req-17e328c6-abdf-4c0d-b133-bfb08177469e service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:37.153831 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-9c766246-6642-4d60-920a-8a83c416056d req-17e328c6-abdf-4c0d-b133-bfb08177469e service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:37.166016 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-9c766246-6642-4d60-920a-8a83c416056d req-17e328c6-abdf-4c0d-b133-bfb08177469e service nova] Creating event network-changed:ca45ea26-ebef-4cf1-b670-b108bd4e54d4 for instance c8063f90-dde5-4697-b772-2d63abfae0ec on hv-cinder-84159 May 13 13:27:37.171382 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-9c766246-6642-4d60-920a-8a83c416056d req-17e328c6-abdf-4c0d-b133-bfb08177469e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033000 May 13 13:27:37.172272 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 172/363] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:37.406630 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-111f34c0-4cef-4e6c-b423-8f00e78cca65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:37.407419 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-111f34c0-4cef-4e6c-b423-8f00e78cca65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:37.413746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-111f34c0-4cef-4e6c-b423-8f00e78cca65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:37.414240 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-111f34c0-4cef-4e6c-b423-8f00e78cca65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:37.415053 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-111f34c0-4cef-4e6c-b423-8f00e78cca65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:37.415496 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-111f34c0-4cef-4e6c-b423-8f00e78cca65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:37.514571 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f66341f0-4cbd-4f3b-bcd5-58af8ddb1955 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:37.515289 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f66341f0-4cbd-4f3b-bcd5-58af8ddb1955 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:37.521653 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f66341f0-4cbd-4f3b-bcd5-58af8ddb1955 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:37.522141 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f66341f0-4cbd-4f3b-bcd5-58af8ddb1955 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:37.522976 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f66341f0-4cbd-4f3b-bcd5-58af8ddb1955 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:37.523358 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f66341f0-4cbd-4f3b-bcd5-58af8ddb1955 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:37.589301 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-111f34c0-4cef-4e6c-b423-8f00e78cca65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:37.600002 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-111f34c0-4cef-4e6c-b423-8f00e78cca65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:37.601517 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-111f34c0-4cef-4e6c-b423-8f00e78cca65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:37.622408 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-111f34c0-4cef-4e6c-b423-8f00e78cca65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1739 microversion: 2.20 time: 0.213717 May 13 13:27:37.623374 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 192/364] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:37 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:37.632435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-481fba43-8bbd-4532-9462-01ed81f226a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:37.634513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-481fba43-8bbd-4532-9462-01ed81f226a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:37.646687 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-481fba43-8bbd-4532-9462-01ed81f226a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:37.651176 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-481fba43-8bbd-4532-9462-01ed81f226a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:37.651176 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-481fba43-8bbd-4532-9462-01ed81f226a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:37.651176 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-481fba43-8bbd-4532-9462-01ed81f226a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:37.769552 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f66341f0-4cbd-4f3b-bcd5-58af8ddb1955 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:37.777729 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f66341f0-4cbd-4f3b-bcd5-58af8ddb1955 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1700 microversion: 2.1 time: 0.267463 May 13 13:27:37.783340 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 173/365] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:37 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1700 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:37.810176 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-761ddf41-a0ad-4ea9-8e75-c51e2659c6a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:37.829672 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-761ddf41-a0ad-4ea9-8e75-c51e2659c6a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:37.838288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-761ddf41-a0ad-4ea9-8e75-c51e2659c6a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:37.870176 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-481fba43-8bbd-4532-9462-01ed81f226a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:37.881182 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-481fba43-8bbd-4532-9462-01ed81f226a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1319 microversion: 2.1 time: 0.256489 May 13 13:27:37.883175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 193/366] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:37 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:37.925467 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-761ddf41-a0ad-4ea9-8e75-c51e2659c6a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Going to try to start instance {{(pid=117602) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 13:27:37.952608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0b6e89a2-2834-4f40-85ea-f66bbed6e30c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:37.953644 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0b6e89a2-2834-4f40-85ea-f66bbed6e30c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:37.963395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0b6e89a2-2834-4f40-85ea-f66bbed6e30c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:37.964225 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0b6e89a2-2834-4f40-85ea-f66bbed6e30c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:37.965054 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0b6e89a2-2834-4f40-85ea-f66bbed6e30c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:37.966311 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0b6e89a2-2834-4f40-85ea-f66bbed6e30c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:38.119380 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0b6e89a2-2834-4f40-85ea-f66bbed6e30c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:38.130848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0b6e89a2-2834-4f40-85ea-f66bbed6e30c tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.182302 May 13 13:27:38.131320 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 194/367] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:37 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:38.166508 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-761ddf41-a0ad-4ea9-8e75-c51e2659c6a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "POST /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/action" status: 202 len: 0 microversion: 2.1 time: 0.365568 May 13 13:27:38.166508 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 174/368] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:27:37 2022] POST /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:27:38.173344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-11212791-6282-4cf5-ae98-4fda901c05ac tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:38.174003 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-11212791-6282-4cf5-ae98-4fda901c05ac tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:38.189007 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11212791-6282-4cf5-ae98-4fda901c05ac tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:38.191596 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11212791-6282-4cf5-ae98-4fda901c05ac tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:38.192416 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11212791-6282-4cf5-ae98-4fda901c05ac tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:38.193707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11212791-6282-4cf5-ae98-4fda901c05ac tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:38.401759 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-11212791-6282-4cf5-ae98-4fda901c05ac tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:38.410811 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-11212791-6282-4cf5-ae98-4fda901c05ac tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1709 microversion: 2.1 time: 0.243005 May 13 13:27:38.418521 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 195/369] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:38 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1709 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:38.646917 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6f263c53-8bb2-40ab-82d8-3d0a8eb74877 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:38.646917 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6f263c53-8bb2-40ab-82d8-3d0a8eb74877 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:38.650830 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6f263c53-8bb2-40ab-82d8-3d0a8eb74877 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:38.651375 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6f263c53-8bb2-40ab-82d8-3d0a8eb74877 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:38.652301 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6f263c53-8bb2-40ab-82d8-3d0a8eb74877 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:38.652759 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6f263c53-8bb2-40ab-82d8-3d0a8eb74877 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:38.794855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6f263c53-8bb2-40ab-82d8-3d0a8eb74877 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:38.806359 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6f263c53-8bb2-40ab-82d8-3d0a8eb74877 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:38.808085 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6f263c53-8bb2-40ab-82d8-3d0a8eb74877 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:38.809415 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6f263c53-8bb2-40ab-82d8-3d0a8eb74877 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1721 microversion: 2.20 time: 0.172054 May 13 13:27:38.810730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 175/370] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:38 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:27:38.898925 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a8c1eacb-3f01-481e-a8d7-665286c8b41d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:38.900161 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a8c1eacb-3f01-481e-a8d7-665286c8b41d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:38.906394 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a8c1eacb-3f01-481e-a8d7-665286c8b41d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:38.907069 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a8c1eacb-3f01-481e-a8d7-665286c8b41d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:38.908661 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a8c1eacb-3f01-481e-a8d7-665286c8b41d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:38.909115 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a8c1eacb-3f01-481e-a8d7-665286c8b41d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:39.065587 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a8c1eacb-3f01-481e-a8d7-665286c8b41d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:39.073012 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a8c1eacb-3f01-481e-a8d7-665286c8b41d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1508 microversion: 2.1 time: 0.178131 May 13 13:27:39.073576 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 196/371] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:38 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:39.147336 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-da936c95-30d1-4f03-a6e6-275b951554a0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:39.147949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-da936c95-30d1-4f03-a6e6-275b951554a0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:39.154106 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-da936c95-30d1-4f03-a6e6-275b951554a0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:39.155083 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-da936c95-30d1-4f03-a6e6-275b951554a0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:39.156241 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-da936c95-30d1-4f03-a6e6-275b951554a0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:39.156704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-da936c95-30d1-4f03-a6e6-275b951554a0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:39.290049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-da936c95-30d1-4f03-a6e6-275b951554a0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:39.299243 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-da936c95-30d1-4f03-a6e6-275b951554a0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1314 microversion: 2.1 time: 0.155871 May 13 13:27:39.299809 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 176/372] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:39 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:39.427867 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8a0a5081-7050-42cc-98fd-593f5bf9f509 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:39.428636 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8a0a5081-7050-42cc-98fd-593f5bf9f509 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:39.434735 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a0a5081-7050-42cc-98fd-593f5bf9f509 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:39.435192 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a0a5081-7050-42cc-98fd-593f5bf9f509 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:39.436014 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a0a5081-7050-42cc-98fd-593f5bf9f509 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:39.436462 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a0a5081-7050-42cc-98fd-593f5bf9f509 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:39.671273 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8a0a5081-7050-42cc-98fd-593f5bf9f509 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:39.679198 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8a0a5081-7050-42cc-98fd-593f5bf9f509 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1709 microversion: 2.1 time: 0.255230 May 13 13:27:39.684254 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 197/373] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:39 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1709 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:39.830522 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-07ade197-0ef0-49bc-a550-af9193a76ab2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:39.831405 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-07ade197-0ef0-49bc-a550-af9193a76ab2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:39.838103 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-07ade197-0ef0-49bc-a550-af9193a76ab2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:39.853149 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-07ade197-0ef0-49bc-a550-af9193a76ab2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:39.853149 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-07ade197-0ef0-49bc-a550-af9193a76ab2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:39.853149 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-07ade197-0ef0-49bc-a550-af9193a76ab2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:39.985153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-07ade197-0ef0-49bc-a550-af9193a76ab2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:39.993051 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-07ade197-0ef0-49bc-a550-af9193a76ab2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:39.994597 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-07ade197-0ef0-49bc-a550-af9193a76ab2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:39.995746 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-07ade197-0ef0-49bc-a550-af9193a76ab2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1721 microversion: 2.20 time: 0.169836 May 13 13:27:39.996383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 177/374] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:39 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:40.315056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c03441e8-74f4-44f9-940a-597e74af8d82 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:40.315676 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c03441e8-74f4-44f9-940a-597e74af8d82 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:40.321597 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c03441e8-74f4-44f9-940a-597e74af8d82 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:40.325334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c03441e8-74f4-44f9-940a-597e74af8d82 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:40.325334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c03441e8-74f4-44f9-940a-597e74af8d82 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:40.325334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c03441e8-74f4-44f9-940a-597e74af8d82 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:40.462937 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c03441e8-74f4-44f9-940a-597e74af8d82 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:40.471216 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c03441e8-74f4-44f9-940a-597e74af8d82 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1497 microversion: 2.1 time: 0.159881 May 13 13:27:40.473872 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 198/375] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:40 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:40.632962 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-97359961-7cdb-49c4-bd03-9150bdd312f6 req-e137b6ae-9b1b-48c5-b806-ec4b2664d5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89412841-b653-4a80-8cde-0c7a264a9c4c", "name": "network-vif-unplugged", "status": "completed", "tag": "1a4cef43-4ad0-41f0-9857-11ea57340642"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:40.641523 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-97359961-7cdb-49c4-bd03-9150bdd312f6 req-e137b6ae-9b1b-48c5-b806-ec4b2664d5f0 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:40.642014 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-97359961-7cdb-49c4-bd03-9150bdd312f6 req-e137b6ae-9b1b-48c5-b806-ec4b2664d5f0 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:40.653047 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-97359961-7cdb-49c4-bd03-9150bdd312f6 req-e137b6ae-9b1b-48c5-b806-ec4b2664d5f0 service nova] Creating event network-vif-unplugged:1a4cef43-4ad0-41f0-9857-11ea57340642 for instance 89412841-b653-4a80-8cde-0c7a264a9c4c on hv-cinder-84159 May 13 13:27:40.657870 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-97359961-7cdb-49c4-bd03-9150bdd312f6 req-e137b6ae-9b1b-48c5-b806-ec4b2664d5f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028574 May 13 13:27:40.658450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 178/376] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:40.696345 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-28a93bc3-a05d-4363-b22a-310a35ed5481 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:40.697770 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-28a93bc3-a05d-4363-b22a-310a35ed5481 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:40.704116 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-28a93bc3-a05d-4363-b22a-310a35ed5481 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:40.704589 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-28a93bc3-a05d-4363-b22a-310a35ed5481 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:40.705372 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-28a93bc3-a05d-4363-b22a-310a35ed5481 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:40.705837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-28a93bc3-a05d-4363-b22a-310a35ed5481 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:40.841765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-28a93bc3-a05d-4363-b22a-310a35ed5481 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:40.849993 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-28a93bc3-a05d-4363-b22a-310a35ed5481 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1709 microversion: 2.1 time: 0.157531 May 13 13:27:40.850659 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 199/377] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:40 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1709 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:41.015951 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-363628ad-2f04-4444-b313-74bc860e1502 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:41.016670 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-363628ad-2f04-4444-b313-74bc860e1502 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:41.023242 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-363628ad-2f04-4444-b313-74bc860e1502 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:41.023781 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-363628ad-2f04-4444-b313-74bc860e1502 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:41.024478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-363628ad-2f04-4444-b313-74bc860e1502 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:41.025087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-363628ad-2f04-4444-b313-74bc860e1502 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:41.165043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-363628ad-2f04-4444-b313-74bc860e1502 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:41.173555 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-363628ad-2f04-4444-b313-74bc860e1502 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:41.175109 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-363628ad-2f04-4444-b313-74bc860e1502 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:41.176247 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-363628ad-2f04-4444-b313-74bc860e1502 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1721 microversion: 2.20 time: 0.165198 May 13 13:27:41.176802 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 179/378] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:41 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:41.866472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-668a2adb-3454-47ad-a4cc-236cd79a2b13 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:41.867108 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-668a2adb-3454-47ad-a4cc-236cd79a2b13 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:41.873152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-668a2adb-3454-47ad-a4cc-236cd79a2b13 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:41.873625 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-668a2adb-3454-47ad-a4cc-236cd79a2b13 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:41.874455 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-668a2adb-3454-47ad-a4cc-236cd79a2b13 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:41.874898 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-668a2adb-3454-47ad-a4cc-236cd79a2b13 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.029492 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-668a2adb-3454-47ad-a4cc-236cd79a2b13 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:42.037771 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-668a2adb-3454-47ad-a4cc-236cd79a2b13 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1709 microversion: 2.1 time: 0.175136 May 13 13:27:42.038357 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 200/379] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:41 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1709 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:42.195067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d824bfaa-c77a-4ae7-a820-9339065802b1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:42.195671 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d824bfaa-c77a-4ae7-a820-9339065802b1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:42.202797 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d824bfaa-c77a-4ae7-a820-9339065802b1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.203242 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d824bfaa-c77a-4ae7-a820-9339065802b1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.204008 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d824bfaa-c77a-4ae7-a820-9339065802b1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:42.204441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d824bfaa-c77a-4ae7-a820-9339065802b1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:42.332067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d824bfaa-c77a-4ae7-a820-9339065802b1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:42.339646 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d824bfaa-c77a-4ae7-a820-9339065802b1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:42.341133 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d824bfaa-c77a-4ae7-a820-9339065802b1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:42.342368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d824bfaa-c77a-4ae7-a820-9339065802b1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1721 microversion: 2.20 time: 0.151222 May 13 13:27:42.342919 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 180/380] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:42 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:27:43.057130 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4ed9a754-7369-49ed-ba4e-2cedda92fce1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:43.057731 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4ed9a754-7369-49ed-ba4e-2cedda92fce1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:43.063516 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4ed9a754-7369-49ed-ba4e-2cedda92fce1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:43.063967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4ed9a754-7369-49ed-ba4e-2cedda92fce1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:43.064725 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4ed9a754-7369-49ed-ba4e-2cedda92fce1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:43.065159 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4ed9a754-7369-49ed-ba4e-2cedda92fce1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:43.191807 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4ed9a754-7369-49ed-ba4e-2cedda92fce1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:43.199738 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4ed9a754-7369-49ed-ba4e-2cedda92fce1 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1709 microversion: 2.1 time: 0.146082 May 13 13:27:43.200279 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 201/381] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:43 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1709 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:43.360332 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d4c284ac-0496-4d0d-8eb8-fed7614ddfef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:43.361019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d4c284ac-0496-4d0d-8eb8-fed7614ddfef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:43.367287 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d4c284ac-0496-4d0d-8eb8-fed7614ddfef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:43.367742 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d4c284ac-0496-4d0d-8eb8-fed7614ddfef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:43.368516 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d4c284ac-0496-4d0d-8eb8-fed7614ddfef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:43.368959 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d4c284ac-0496-4d0d-8eb8-fed7614ddfef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:43.496104 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d4c284ac-0496-4d0d-8eb8-fed7614ddfef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:43.503906 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d4c284ac-0496-4d0d-8eb8-fed7614ddfef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:43.505421 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d4c284ac-0496-4d0d-8eb8-fed7614ddfef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:43.506606 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d4c284ac-0496-4d0d-8eb8-fed7614ddfef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1721 microversion: 2.20 time: 0.150170 May 13 13:27:43.507164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 181/382] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:43 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:44.216478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fbb62f13-4c2f-4513-bac4-506c060977df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:44.217125 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fbb62f13-4c2f-4513-bac4-506c060977df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:44.222886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fbb62f13-4c2f-4513-bac4-506c060977df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:44.223337 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fbb62f13-4c2f-4513-bac4-506c060977df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:44.224106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fbb62f13-4c2f-4513-bac4-506c060977df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:44.224545 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fbb62f13-4c2f-4513-bac4-506c060977df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:44.354034 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fbb62f13-4c2f-4513-bac4-506c060977df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:44.362457 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fbb62f13-4c2f-4513-bac4-506c060977df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1709 microversion: 2.1 time: 0.149972 May 13 13:27:44.363015 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 202/383] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:44 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:44.481724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3d9196db-2267-4d6c-9d88-97e075dabb19 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:44.482264 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3d9196db-2267-4d6c-9d88-97e075dabb19 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:44.489478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3d9196db-2267-4d6c-9d88-97e075dabb19 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:44.490008 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3d9196db-2267-4d6c-9d88-97e075dabb19 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:44.491026 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3d9196db-2267-4d6c-9d88-97e075dabb19 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:44.491475 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3d9196db-2267-4d6c-9d88-97e075dabb19 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:44.516826 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3d9196db-2267-4d6c-9d88-97e075dabb19 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Going to try to terminate instance {{(pid=117602) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:27:44.524435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fe3fd328-2187-4e83-9a72-e7a67e17443c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:44.525252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fe3fd328-2187-4e83-9a72-e7a67e17443c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:44.531742 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fe3fd328-2187-4e83-9a72-e7a67e17443c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:44.532198 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fe3fd328-2187-4e83-9a72-e7a67e17443c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:44.533000 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fe3fd328-2187-4e83-9a72-e7a67e17443c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:44.533441 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fe3fd328-2187-4e83-9a72-e7a67e17443c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:44.680728 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fe3fd328-2187-4e83-9a72-e7a67e17443c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:44.689119 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fe3fd328-2187-4e83-9a72-e7a67e17443c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:44.690709 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fe3fd328-2187-4e83-9a72-e7a67e17443c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:44.691896 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fe3fd328-2187-4e83-9a72-e7a67e17443c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1721 microversion: 2.20 time: 0.171360 May 13 13:27:44.692690 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 203/384] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:44 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:27:44.869798 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3d9196db-2267-4d6c-9d88-97e075dabb19 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 204 len: 0 microversion: 2.1 time: 0.391521 May 13 13:27:44.870413 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 182/385] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:27:44 2022] DELETE /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 13:27:44.878464 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cd6cfc23-b490-4035-a80c-faac7988bbb8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:44.879071 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cd6cfc23-b490-4035-a80c-faac7988bbb8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:44.885279 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd6cfc23-b490-4035-a80c-faac7988bbb8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:44.885738 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd6cfc23-b490-4035-a80c-faac7988bbb8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:44.886588 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd6cfc23-b490-4035-a80c-faac7988bbb8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:44.887031 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cd6cfc23-b490-4035-a80c-faac7988bbb8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:45.019779 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cd6cfc23-b490-4035-a80c-faac7988bbb8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:45.027116 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cd6cfc23-b490-4035-a80c-faac7988bbb8 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1503 microversion: 2.1 time: 0.152483 May 13 13:27:45.027685 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 204/386] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:44 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:45.383470 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-73127c04-d1fb-4fd3-a2f0-a028efb640df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:45.384095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-73127c04-d1fb-4fd3-a2f0-a028efb640df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:45.390650 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-73127c04-d1fb-4fd3-a2f0-a028efb640df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:45.391143 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-73127c04-d1fb-4fd3-a2f0-a028efb640df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:45.391917 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-73127c04-d1fb-4fd3-a2f0-a028efb640df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:45.392360 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-73127c04-d1fb-4fd3-a2f0-a028efb640df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:45.528080 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-73127c04-d1fb-4fd3-a2f0-a028efb640df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:45.535938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-73127c04-d1fb-4fd3-a2f0-a028efb640df tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1709 microversion: 2.1 time: 0.159347 May 13 13:27:45.536508 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 183/387] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:45 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:45.711280 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bdd3e131-a342-4c58-8dda-458beaa1ac3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:45.711900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bdd3e131-a342-4c58-8dda-458beaa1ac3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:45.717869 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdd3e131-a342-4c58-8dda-458beaa1ac3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:45.718312 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdd3e131-a342-4c58-8dda-458beaa1ac3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:45.719135 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdd3e131-a342-4c58-8dda-458beaa1ac3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:45.719580 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bdd3e131-a342-4c58-8dda-458beaa1ac3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:45.851960 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bdd3e131-a342-4c58-8dda-458beaa1ac3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:45.860380 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bdd3e131-a342-4c58-8dda-458beaa1ac3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:45.862004 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bdd3e131-a342-4c58-8dda-458beaa1ac3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:45.863203 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bdd3e131-a342-4c58-8dda-458beaa1ac3e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1721 microversion: 2.20 time: 0.156052 May 13 13:27:45.863762 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 205/388] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:45 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:46.044659 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-fd300e7e-76cc-4743-bc0f-ba5e3d72d9bd tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:46.045902 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-fd300e7e-76cc-4743-bc0f-ba5e3d72d9bd tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:46.052460 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fd300e7e-76cc-4743-bc0f-ba5e3d72d9bd tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:46.052923 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fd300e7e-76cc-4743-bc0f-ba5e3d72d9bd tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:46.053700 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fd300e7e-76cc-4743-bc0f-ba5e3d72d9bd tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:46.054177 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fd300e7e-76cc-4743-bc0f-ba5e3d72d9bd tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:46.188376 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-fd300e7e-76cc-4743-bc0f-ba5e3d72d9bd tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:46.195810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-fd300e7e-76cc-4743-bc0f-ba5e3d72d9bd tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1503 microversion: 2.1 time: 0.155043 May 13 13:27:46.196360 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 184/389] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:46 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:46.553213 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e1312d3f-851b-42ce-9935-5cbc9536588a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:46.553857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e1312d3f-851b-42ce-9935-5cbc9536588a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:46.559986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1312d3f-851b-42ce-9935-5cbc9536588a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:46.560442 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1312d3f-851b-42ce-9935-5cbc9536588a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:46.561243 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1312d3f-851b-42ce-9935-5cbc9536588a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:46.561683 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e1312d3f-851b-42ce-9935-5cbc9536588a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:46.691719 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e1312d3f-851b-42ce-9935-5cbc9536588a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:46.699796 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e1312d3f-851b-42ce-9935-5cbc9536588a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1709 microversion: 2.1 time: 0.150196 May 13 13:27:46.700400 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 206/390] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:46 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:46.881551 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-762932f0-dac4-46ce-9441-a6233f4872e3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:46.882117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-762932f0-dac4-46ce-9441-a6233f4872e3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:46.888440 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-762932f0-dac4-46ce-9441-a6233f4872e3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:46.889562 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-762932f0-dac4-46ce-9441-a6233f4872e3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:46.890411 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-762932f0-dac4-46ce-9441-a6233f4872e3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:46.890856 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-762932f0-dac4-46ce-9441-a6233f4872e3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.022318 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-762932f0-dac4-46ce-9441-a6233f4872e3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:47.030280 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-762932f0-dac4-46ce-9441-a6233f4872e3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:47.031809 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-762932f0-dac4-46ce-9441-a6233f4872e3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:47.032958 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-762932f0-dac4-46ce-9441-a6233f4872e3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1724 microversion: 2.20 time: 0.155493 May 13 13:27:47.033513 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 185/391] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:46 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:47.051157 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d791b17d-e7c2-4770-a4e1-90804d829fe7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc1dc3c8-3d1a-4b45-982f-edb484911545"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:47.052291 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d791b17d-e7c2-4770-a4e1-90804d829fe7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:47.058227 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d791b17d-e7c2-4770-a4e1-90804d829fe7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:47.058678 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d791b17d-e7c2-4770-a4e1-90804d829fe7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.059447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d791b17d-e7c2-4770-a4e1-90804d829fe7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:47.059886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d791b17d-e7c2-4770-a4e1-90804d829fe7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.212768 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2f5b3d4e-962f-4353-aa3f-5090205e2000 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:47.213382 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2f5b3d4e-962f-4353-aa3f-5090205e2000 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:47.219369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2f5b3d4e-962f-4353-aa3f-5090205e2000 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:47.219826 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2f5b3d4e-962f-4353-aa3f-5090205e2000 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.220631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2f5b3d4e-962f-4353-aa3f-5090205e2000 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:47.221072 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2f5b3d4e-962f-4353-aa3f-5090205e2000 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.352734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2f5b3d4e-962f-4353-aa3f-5090205e2000 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:47.360148 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2f5b3d4e-962f-4353-aa3f-5090205e2000 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1503 microversion: 2.1 time: 0.151196 May 13 13:27:47.360709 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 186/392] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:47 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:47.720404 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9f473e2b-32b2-454e-bf9d-7c8c5eb8e1b8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:47.721007 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-9f473e2b-32b2-454e-bf9d-7c8c5eb8e1b8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:47.726875 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9f473e2b-32b2-454e-bf9d-7c8c5eb8e1b8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:47.727323 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9f473e2b-32b2-454e-bf9d-7c8c5eb8e1b8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.728092 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9f473e2b-32b2-454e-bf9d-7c8c5eb8e1b8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:47.728520 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9f473e2b-32b2-454e-bf9d-7c8c5eb8e1b8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:47.860690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-9f473e2b-32b2-454e-bf9d-7c8c5eb8e1b8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:47.868784 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-9f473e2b-32b2-454e-bf9d-7c8c5eb8e1b8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1709 microversion: 2.1 time: 0.152253 May 13 13:27:47.869356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 187/393] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:47 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:48.180817 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d791b17d-e7c2-4770-a4e1-90804d829fe7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "POST /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.133477 May 13 13:27:48.181612 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 207/394] 10.222.0.25 () {62 vars in 1363 bytes} [Fri May 13 13:27:47 2022] POST /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments => generated 188 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:27:48.302345 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-854187f5-3bb1-488e-a7ec-5411ab369950 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:48.302916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-854187f5-3bb1-488e-a7ec-5411ab369950 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:48.309447 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-854187f5-3bb1-488e-a7ec-5411ab369950 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.309958 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-854187f5-3bb1-488e-a7ec-5411ab369950 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.311300 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-854187f5-3bb1-488e-a7ec-5411ab369950 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.311770 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-854187f5-3bb1-488e-a7ec-5411ab369950 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.377078 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-dd28db86-470b-4711-9bff-adc99a0ab143 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:48.377820 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-dd28db86-470b-4711-9bff-adc99a0ab143 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:48.383806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dd28db86-470b-4711-9bff-adc99a0ab143 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.384262 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dd28db86-470b-4711-9bff-adc99a0ab143 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.385050 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dd28db86-470b-4711-9bff-adc99a0ab143 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.385567 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dd28db86-470b-4711-9bff-adc99a0ab143 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.518018 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-dd28db86-470b-4711-9bff-adc99a0ab143 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:48.525561 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-dd28db86-470b-4711-9bff-adc99a0ab143 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1503 microversion: 2.1 time: 0.152879 May 13 13:27:48.526172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 208/395] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:48 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:27:48.672130 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-854187f5-3bb1-488e-a7ec-5411ab369950 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "POST /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/action" status: 202 len: 0 microversion: 2.20 time: 0.373601 May 13 13:27:48.672874 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 188/396] 10.222.0.25 () {62 vars in 1318 bytes} [Fri May 13 13:27:48 2022] POST /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:27:48.680865 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a3204681-1a1e-41a8-98cf-2309eaeaca36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:48.681478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a3204681-1a1e-41a8-98cf-2309eaeaca36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:48.688043 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3204681-1a1e-41a8-98cf-2309eaeaca36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.690491 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3204681-1a1e-41a8-98cf-2309eaeaca36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.690491 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3204681-1a1e-41a8-98cf-2309eaeaca36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.690491 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a3204681-1a1e-41a8-98cf-2309eaeaca36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.841334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a3204681-1a1e-41a8-98cf-2309eaeaca36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:48.851911 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a3204681-1a1e-41a8-98cf-2309eaeaca36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:48.853478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a3204681-1a1e-41a8-98cf-2309eaeaca36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:48.854898 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a3204681-1a1e-41a8-98cf-2309eaeaca36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1810 microversion: 2.20 time: 0.177872 May 13 13:27:48.855456 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 209/397] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:48 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:27:48.885772 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e8501afe-e5d7-4067-ad45-ab5d256b729f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:48.886413 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e8501afe-e5d7-4067-ad45-ab5d256b729f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:48.892563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e8501afe-e5d7-4067-ad45-ab5d256b729f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.893023 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e8501afe-e5d7-4067-ad45-ab5d256b729f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:48.893837 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e8501afe-e5d7-4067-ad45-ab5d256b729f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:48.894329 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e8501afe-e5d7-4067-ad45-ab5d256b729f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:49.031587 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e8501afe-e5d7-4067-ad45-ab5d256b729f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:49.039340 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e8501afe-e5d7-4067-ad45-ab5d256b729f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1709 microversion: 2.1 time: 0.157487 May 13 13:27:49.039866 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 189/398] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:48 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1709 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:49.542467 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c8c347ed-4002-42ae-aaf9-4e49ff9968ec tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:49.543202 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c8c347ed-4002-42ae-aaf9-4e49ff9968ec tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:49.550078 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c8c347ed-4002-42ae-aaf9-4e49ff9968ec tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:49.550619 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c8c347ed-4002-42ae-aaf9-4e49ff9968ec tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:49.551401 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c8c347ed-4002-42ae-aaf9-4e49ff9968ec tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:49.551847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c8c347ed-4002-42ae-aaf9-4e49ff9968ec tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:49.715499 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c8c347ed-4002-42ae-aaf9-4e49ff9968ec tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:49.729765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c8c347ed-4002-42ae-aaf9-4e49ff9968ec tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1503 microversion: 2.1 time: 0.190893 May 13 13:27:49.730493 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 210/399] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:49 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:49.873263 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-adc1d254-b07e-45c4-ab7d-46f4943dd246 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:49.873934 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-adc1d254-b07e-45c4-ab7d-46f4943dd246 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:49.880333 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-adc1d254-b07e-45c4-ab7d-46f4943dd246 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:49.880789 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-adc1d254-b07e-45c4-ab7d-46f4943dd246 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:49.881775 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-adc1d254-b07e-45c4-ab7d-46f4943dd246 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:49.882233 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-adc1d254-b07e-45c4-ab7d-46f4943dd246 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:50.015413 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-adc1d254-b07e-45c4-ab7d-46f4943dd246 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:50.024086 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-adc1d254-b07e-45c4-ab7d-46f4943dd246 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:50.025548 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-adc1d254-b07e-45c4-ab7d-46f4943dd246 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:50.026755 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-adc1d254-b07e-45c4-ab7d-46f4943dd246 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1810 microversion: 2.20 time: 0.157638 May 13 13:27:50.027527 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 190/400] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:49 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:50.055445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7d1fca62-7228-4dbd-9620-f2d1468071eb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:50.056168 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7d1fca62-7228-4dbd-9620-f2d1468071eb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:50.062123 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d1fca62-7228-4dbd-9620-f2d1468071eb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:50.062578 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d1fca62-7228-4dbd-9620-f2d1468071eb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:50.063356 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d1fca62-7228-4dbd-9620-f2d1468071eb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:50.063798 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d1fca62-7228-4dbd-9620-f2d1468071eb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:50.192837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7d1fca62-7228-4dbd-9620-f2d1468071eb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:50.201210 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7d1fca62-7228-4dbd-9620-f2d1468071eb tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1713 microversion: 2.1 time: 0.149468 May 13 13:27:50.202435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 211/401] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:50 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1713 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:50.747292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-03bedcc4-6b7c-46cf-a9d6-a7a87b1b469e tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:50.747893 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-03bedcc4-6b7c-46cf-a9d6-a7a87b1b469e tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:50.754358 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03bedcc4-6b7c-46cf-a9d6-a7a87b1b469e tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:50.754805 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03bedcc4-6b7c-46cf-a9d6-a7a87b1b469e tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:50.755576 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03bedcc4-6b7c-46cf-a9d6-a7a87b1b469e tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:50.756006 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03bedcc4-6b7c-46cf-a9d6-a7a87b1b469e tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:50.909169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-03bedcc4-6b7c-46cf-a9d6-a7a87b1b469e tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:50.916553 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-03bedcc4-6b7c-46cf-a9d6-a7a87b1b469e tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1503 microversion: 2.1 time: 0.173060 May 13 13:27:50.917445 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 191/402] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:50 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:51.045073 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-23688e8a-199c-49e6-aec9-2fa084981059 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:51.045608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-23688e8a-199c-49e6-aec9-2fa084981059 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:51.051572 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23688e8a-199c-49e6-aec9-2fa084981059 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:51.052030 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23688e8a-199c-49e6-aec9-2fa084981059 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:51.052806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23688e8a-199c-49e6-aec9-2fa084981059 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:51.053249 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23688e8a-199c-49e6-aec9-2fa084981059 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:51.253479 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-23688e8a-199c-49e6-aec9-2fa084981059 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:51.261870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-23688e8a-199c-49e6-aec9-2fa084981059 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:51.263371 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-23688e8a-199c-49e6-aec9-2fa084981059 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:51.264704 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-23688e8a-199c-49e6-aec9-2fa084981059 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1810 microversion: 2.20 time: 0.223644 May 13 13:27:51.265265 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 212/403] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:51 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:51.545538 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-f12d1f9d-2afe-468c-be92-7a49bd2634d0 req-325c27d2-309f-49d5-9ec6-9123a3a1e5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebdcbcf7-a949-4081-9b20-5784ff43d5d9", "name": "network-vif-deleted", "tag": "6d5de545-d4ec-4140-b705-2775719cf186"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:27:51.554218 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-f12d1f9d-2afe-468c-be92-7a49bd2634d0 req-325c27d2-309f-49d5-9ec6-9123a3a1e5f2 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:51.554669 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-f12d1f9d-2afe-468c-be92-7a49bd2634d0 req-325c27d2-309f-49d5-9ec6-9123a3a1e5f2 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:51.567077 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-f12d1f9d-2afe-468c-be92-7a49bd2634d0 req-325c27d2-309f-49d5-9ec6-9123a3a1e5f2 service nova] Creating event network-vif-deleted:6d5de545-d4ec-4140-b705-2775719cf186 for instance ebdcbcf7-a949-4081-9b20-5784ff43d5d9 on hv-cinder-84159 May 13 13:27:51.572109 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-f12d1f9d-2afe-468c-be92-7a49bd2634d0 req-325c27d2-309f-49d5-9ec6-9123a3a1e5f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030397 May 13 13:27:51.573015 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 192/404] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:27:51.933834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bc2af3f0-587d-41a0-8f0e-1a6d6b5f5cc0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:51.934455 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bc2af3f0-587d-41a0-8f0e-1a6d6b5f5cc0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:51.941145 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bc2af3f0-587d-41a0-8f0e-1a6d6b5f5cc0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:51.941607 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bc2af3f0-587d-41a0-8f0e-1a6d6b5f5cc0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:51.942407 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bc2af3f0-587d-41a0-8f0e-1a6d6b5f5cc0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:51.942852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bc2af3f0-587d-41a0-8f0e-1a6d6b5f5cc0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:51.974011 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bc2af3f0-587d-41a0-8f0e-1a6d6b5f5cc0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:51.974449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bc2af3f0-587d-41a0-8f0e-1a6d6b5f5cc0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:51.978965 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-bc2af3f0-587d-41a0-8f0e-1a6d6b5f5cc0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lazy-loading 'fault' on Instance uuid ebdcbcf7-a949-4081-9b20-5784ff43d5d9 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:27:52.019300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bc2af3f0-587d-41a0-8f0e-1a6d6b5f5cc0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cdee89f8a8040ca944458d3fc6f18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea1460c53954c6a915fc638a2690cbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:52.026966 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bc2af3f0-587d-41a0-8f0e-1a6d6b5f5cc0 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 200 len: 1304 microversion: 2.1 time: 0.096955 May 13 13:27:52.027561 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 213/405] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:51 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:27:52.285389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-03b8bdb1-f715-4465-a4a6-1ef71661fa09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:52.286258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-03b8bdb1-f715-4465-a4a6-1ef71661fa09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:52.292829 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03b8bdb1-f715-4465-a4a6-1ef71661fa09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:52.293489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03b8bdb1-f715-4465-a4a6-1ef71661fa09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:52.294491 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03b8bdb1-f715-4465-a4a6-1ef71661fa09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:52.294932 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03b8bdb1-f715-4465-a4a6-1ef71661fa09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:52.433095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-03b8bdb1-f715-4465-a4a6-1ef71661fa09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:52.445773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-03b8bdb1-f715-4465-a4a6-1ef71661fa09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:52.447592 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-03b8bdb1-f715-4465-a4a6-1ef71661fa09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:52.448811 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-03b8bdb1-f715-4465-a4a6-1ef71661fa09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1752 microversion: 2.20 time: 0.169476 May 13 13:27:52.451464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 193/406] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:52 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:53.044228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6f7e2b67-8068-4a03-b201-0f4298ad0385 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:53.044873 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6f7e2b67-8068-4a03-b201-0f4298ad0385 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] [instance: ebdcbcf7-a949-4081-9b20-5784ff43d5d9] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:53.051049 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6f7e2b67-8068-4a03-b201-0f4298ad0385 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:53.056654 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6f7e2b67-8068-4a03-b201-0f4298ad0385 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:53.056654 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6f7e2b67-8068-4a03-b201-0f4298ad0385 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:53.056654 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6f7e2b67-8068-4a03-b201-0f4298ad0385 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:53.065881 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-6f7e2b67-8068-4a03-b201-0f4298ad0385 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] HTTP exception thrown: Instance ebdcbcf7-a949-4081-9b20-5784ff43d5d9 could not be found. May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6f7e2b67-8068-4a03-b201-0f4298ad0385 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Request method failure captured: May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 HTTP/1.1 May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflyXJf_MG7vS43dEGmSlrpLMsfTbBMo6GVdtYErDDnKEDsZvssgdrtS25OKbtSuATPMHHtbA58avLTyf-U3wAv7URsON0KS2yJqMKI5pPNh4wZKIOmhe4KsGRxzMBTnOOM2bq3AQBt2aZqU5MsvT3TXTrRlkcC2nD1BsXNbibT5CFeE May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 3ea1460c53954c6a915fc638a2690cbf May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesActionsTest-1670340122 May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:27:53.067608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:27:53.069242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea1460c53954c6a915fc638a2690cbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ea1460c53954c6a915fc638a2690cbf", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ea1460c53954c6a915fc638a2690cbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ea1460c53954c6a915fc638a2690cbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:27:53.069242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesActionsTest-1670340122 May 13 13:27:53.069242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 3ea1460c53954c6a915fc638a2690cbf May 13 13:27:53.069242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesActionsTest-1670340122 May 13 13:27:53.069242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesActionsTest-1670340122-project May 13 13:27:53.069242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:27:53.069242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:27:53.069242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 1cdee89f8a8040ca944458d3fc6f18eb May 13 13:27:53.069242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesActionsTest-1670340122-project May 13 13:27:53.069242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:27:53.069242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance ebdcbcf7-a949-4081-9b20-5784ff43d5d9 could not be found. May 13 13:27:53.069242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'ebdcbcf7-a949-4081-9b20-5784ff43d5d9'} May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebdcbcf7-a949-4081-9b20-5784ff43d5d9 could not be found. May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:27:53.070195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebdcbcf7-a949-4081-9b20-5784ff43d5d9 could not be found. May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebdcbcf7-a949-4081-9b20-5784ff43d5d9 could not be found. May 13 13:27:53.071900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:27:53.073358 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6f7e2b67-8068-4a03-b201-0f4298ad0385 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] Returning 404 to user: Instance ebdcbcf7-a949-4081-9b20-5784ff43d5d9 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:27:53.073358 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6f7e2b67-8068-4a03-b201-0f4298ad0385 tempest-VolumesActionsTest-1670340122 tempest-VolumesActionsTest-1670340122-project] 10.222.0.25 "GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9" status: 404 len: 111 microversion: 2.1 time: 0.028688 May 13 13:27:53.073358 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 214/407] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:27:53 2022] GET /compute/v2.1/servers/ebdcbcf7-a949-4081-9b20-5784ff43d5d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:27:53.471516 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-dac23c56-b163-4eb0-92a6-fa7a96c68d8f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:53.472781 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-dac23c56-b163-4eb0-92a6-fa7a96c68d8f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:53.514609 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dac23c56-b163-4eb0-92a6-fa7a96c68d8f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:53.515065 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dac23c56-b163-4eb0-92a6-fa7a96c68d8f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:53.520305 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dac23c56-b163-4eb0-92a6-fa7a96c68d8f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:53.520305 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dac23c56-b163-4eb0-92a6-fa7a96c68d8f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:53.655779 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-dac23c56-b163-4eb0-92a6-fa7a96c68d8f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:53.664785 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-dac23c56-b163-4eb0-92a6-fa7a96c68d8f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:53.666831 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-dac23c56-b163-4eb0-92a6-fa7a96c68d8f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:53.668523 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-dac23c56-b163-4eb0-92a6-fa7a96c68d8f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.200878 May 13 13:27:53.680049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 194/408] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:53 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:54.686988 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bff80123-4289-48a6-9fd6-2e2112cce96e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:54.687602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bff80123-4289-48a6-9fd6-2e2112cce96e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:54.694183 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bff80123-4289-48a6-9fd6-2e2112cce96e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:54.694651 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bff80123-4289-48a6-9fd6-2e2112cce96e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:54.695434 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bff80123-4289-48a6-9fd6-2e2112cce96e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:54.695883 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bff80123-4289-48a6-9fd6-2e2112cce96e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:54.832337 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bff80123-4289-48a6-9fd6-2e2112cce96e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:54.840767 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bff80123-4289-48a6-9fd6-2e2112cce96e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:54.846926 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bff80123-4289-48a6-9fd6-2e2112cce96e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:54.846926 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bff80123-4289-48a6-9fd6-2e2112cce96e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.160837 May 13 13:27:54.846926 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 215/409] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:54 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:55.870126 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6f202164-da38-41e5-88f9-31a981073eab tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:55.875935 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6f202164-da38-41e5-88f9-31a981073eab tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:55.887675 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6f202164-da38-41e5-88f9-31a981073eab tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:55.890757 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6f202164-da38-41e5-88f9-31a981073eab tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:55.892842 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6f202164-da38-41e5-88f9-31a981073eab tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:55.894319 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6f202164-da38-41e5-88f9-31a981073eab tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:56.121492 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6f202164-da38-41e5-88f9-31a981073eab tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:56.145139 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6f202164-da38-41e5-88f9-31a981073eab tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:56.146770 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6f202164-da38-41e5-88f9-31a981073eab tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:56.148126 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6f202164-da38-41e5-88f9-31a981073eab tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.282057 May 13 13:27:56.149351 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 195/410] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:55 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:57.168572 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-66695bf4-ce9f-4a8a-a419-18211ce67a73 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:57.171124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-66695bf4-ce9f-4a8a-a419-18211ce67a73 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:57.177549 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66695bf4-ce9f-4a8a-a419-18211ce67a73 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:57.178291 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66695bf4-ce9f-4a8a-a419-18211ce67a73 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:57.179089 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66695bf4-ce9f-4a8a-a419-18211ce67a73 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:57.179528 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66695bf4-ce9f-4a8a-a419-18211ce67a73 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:57.333003 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-66695bf4-ce9f-4a8a-a419-18211ce67a73 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:57.341331 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-66695bf4-ce9f-4a8a-a419-18211ce67a73 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:57.343471 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-66695bf4-ce9f-4a8a-a419-18211ce67a73 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:57.344720 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-66695bf4-ce9f-4a8a-a419-18211ce67a73 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.180175 May 13 13:27:57.345270 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 216/411] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:57 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:58.364850 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-47527a53-def1-4416-8655-d8e4fef90d3c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:58.366182 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-47527a53-def1-4416-8655-d8e4fef90d3c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:58.374179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-47527a53-def1-4416-8655-d8e4fef90d3c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:58.374640 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-47527a53-def1-4416-8655-d8e4fef90d3c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:58.375447 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-47527a53-def1-4416-8655-d8e4fef90d3c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:58.375892 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-47527a53-def1-4416-8655-d8e4fef90d3c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:58.556661 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-47527a53-def1-4416-8655-d8e4fef90d3c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:58.575555 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-47527a53-def1-4416-8655-d8e4fef90d3c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:58.581604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-47527a53-def1-4416-8655-d8e4fef90d3c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:58.584707 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-47527a53-def1-4416-8655-d8e4fef90d3c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.224467 May 13 13:27:58.585274 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 196/412] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:58 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:27:59.603957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f3c13441-f90c-4967-87e4-37317b126623 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:27:59.605101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f3c13441-f90c-4967-87e4-37317b126623 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:27:59.611512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f3c13441-f90c-4967-87e4-37317b126623 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:59.611956 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f3c13441-f90c-4967-87e4-37317b126623 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:59.612720 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f3c13441-f90c-4967-87e4-37317b126623 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:27:59.613176 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f3c13441-f90c-4967-87e4-37317b126623 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:27:59.764496 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f3c13441-f90c-4967-87e4-37317b126623 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:59.776269 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f3c13441-f90c-4967-87e4-37317b126623 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:59.778165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f3c13441-f90c-4967-87e4-37317b126623 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:27:59.781673 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f3c13441-f90c-4967-87e4-37317b126623 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.179392 May 13 13:27:59.781673 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 217/413] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:27:59 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:00.804092 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6de1b67b-be00-499f-ba4e-fdc28c8c3fea tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:00.804734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6de1b67b-be00-499f-ba4e-fdc28c8c3fea tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:00.816107 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6de1b67b-be00-499f-ba4e-fdc28c8c3fea tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:00.818327 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6de1b67b-be00-499f-ba4e-fdc28c8c3fea tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:00.819361 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6de1b67b-be00-499f-ba4e-fdc28c8c3fea tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:00.822438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6de1b67b-be00-499f-ba4e-fdc28c8c3fea tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:01.130936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6de1b67b-be00-499f-ba4e-fdc28c8c3fea tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:01.142544 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6de1b67b-be00-499f-ba4e-fdc28c8c3fea tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:01.143227 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6de1b67b-be00-499f-ba4e-fdc28c8c3fea tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:01.144442 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6de1b67b-be00-499f-ba4e-fdc28c8c3fea tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.348279 May 13 13:28:01.147914 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 197/414] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:00 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:02.164040 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9f4ca634-f9e5-4ded-9016-dfd5ab5bb20a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:02.164659 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9f4ca634-f9e5-4ded-9016-dfd5ab5bb20a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:02.172703 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9f4ca634-f9e5-4ded-9016-dfd5ab5bb20a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:02.176015 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9f4ca634-f9e5-4ded-9016-dfd5ab5bb20a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:02.181085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9f4ca634-f9e5-4ded-9016-dfd5ab5bb20a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:02.181085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9f4ca634-f9e5-4ded-9016-dfd5ab5bb20a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:02.400730 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9f4ca634-f9e5-4ded-9016-dfd5ab5bb20a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:02.422341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9f4ca634-f9e5-4ded-9016-dfd5ab5bb20a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:02.422341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9f4ca634-f9e5-4ded-9016-dfd5ab5bb20a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:02.422341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9f4ca634-f9e5-4ded-9016-dfd5ab5bb20a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.254586 May 13 13:28:02.433115 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 218/415] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:02 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:03.434773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-57ad7977-2f00-4ce6-a833-35b25bf97aa7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:03.435406 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-57ad7977-2f00-4ce6-a833-35b25bf97aa7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:03.447711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-57ad7977-2f00-4ce6-a833-35b25bf97aa7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:03.448172 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-57ad7977-2f00-4ce6-a833-35b25bf97aa7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:03.448982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-57ad7977-2f00-4ce6-a833-35b25bf97aa7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:03.449415 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-57ad7977-2f00-4ce6-a833-35b25bf97aa7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:03.765031 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-57ad7977-2f00-4ce6-a833-35b25bf97aa7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:03.773665 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-57ad7977-2f00-4ce6-a833-35b25bf97aa7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:03.775457 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-57ad7977-2f00-4ce6-a833-35b25bf97aa7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:03.776865 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-57ad7977-2f00-4ce6-a833-35b25bf97aa7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.347194 May 13 13:28:03.789776 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 198/416] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:03 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:28:04.796445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7d75c118-69fa-445c-8853-5081af96e5d5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:04.799056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7d75c118-69fa-445c-8853-5081af96e5d5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:04.813528 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d75c118-69fa-445c-8853-5081af96e5d5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:04.815113 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d75c118-69fa-445c-8853-5081af96e5d5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:04.816200 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d75c118-69fa-445c-8853-5081af96e5d5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:04.816806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7d75c118-69fa-445c-8853-5081af96e5d5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:05.112116 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7d75c118-69fa-445c-8853-5081af96e5d5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:05.130695 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7d75c118-69fa-445c-8853-5081af96e5d5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:05.132246 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7d75c118-69fa-445c-8853-5081af96e5d5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:05.143597 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7d75c118-69fa-445c-8853-5081af96e5d5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.351780 May 13 13:28:05.144823 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 219/417] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:04 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:06.162638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2103271f-76b5-433b-8941-367a3f2606da tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:06.164024 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2103271f-76b5-433b-8941-367a3f2606da tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:06.175860 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2103271f-76b5-433b-8941-367a3f2606da tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:06.178871 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2103271f-76b5-433b-8941-367a3f2606da tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:06.178871 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2103271f-76b5-433b-8941-367a3f2606da tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:06.178871 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2103271f-76b5-433b-8941-367a3f2606da tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:06.565290 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2103271f-76b5-433b-8941-367a3f2606da tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:06.610055 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2103271f-76b5-433b-8941-367a3f2606da tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:06.613621 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2103271f-76b5-433b-8941-367a3f2606da tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:06.615179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2103271f-76b5-433b-8941-367a3f2606da tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.457167 May 13 13:28:06.626769 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 199/418] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:06 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:07.633873 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ce4fde7f-88fe-49d8-964a-79197516864d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:07.634498 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ce4fde7f-88fe-49d8-964a-79197516864d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:07.654128 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce4fde7f-88fe-49d8-964a-79197516864d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:07.655378 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce4fde7f-88fe-49d8-964a-79197516864d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:07.656182 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce4fde7f-88fe-49d8-964a-79197516864d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:07.658823 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce4fde7f-88fe-49d8-964a-79197516864d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:07.933197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ce4fde7f-88fe-49d8-964a-79197516864d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:07.961304 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ce4fde7f-88fe-49d8-964a-79197516864d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:07.975526 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ce4fde7f-88fe-49d8-964a-79197516864d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:07.982588 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ce4fde7f-88fe-49d8-964a-79197516864d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.352495 May 13 13:28:07.983215 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 220/419] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:07 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:08.612601 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8f2e3428-bcca-496f-9387-72b9dc67bc27 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6354c144-44a3-4ea7-b43c-db5f87bb717c", "device": "/dev/sdb"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:08.614421 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8f2e3428-bcca-496f-9387-72b9dc67bc27 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:08.621658 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8f2e3428-bcca-496f-9387-72b9dc67bc27 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:08.627377 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8f2e3428-bcca-496f-9387-72b9dc67bc27 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:08.627377 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8f2e3428-bcca-496f-9387-72b9dc67bc27 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:08.627377 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8f2e3428-bcca-496f-9387-72b9dc67bc27 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:09.002473 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5c30f7a7-3a1d-44d2-9ef8-31f5865d03af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:09.003085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5c30f7a7-3a1d-44d2-9ef8-31f5865d03af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:09.010313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c30f7a7-3a1d-44d2-9ef8-31f5865d03af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:09.016068 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c30f7a7-3a1d-44d2-9ef8-31f5865d03af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:09.019602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c30f7a7-3a1d-44d2-9ef8-31f5865d03af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:09.020284 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c30f7a7-3a1d-44d2-9ef8-31f5865d03af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:09.304536 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5c30f7a7-3a1d-44d2-9ef8-31f5865d03af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:09.316939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5c30f7a7-3a1d-44d2-9ef8-31f5865d03af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:09.320197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5c30f7a7-3a1d-44d2-9ef8-31f5865d03af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:09.321974 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5c30f7a7-3a1d-44d2-9ef8-31f5865d03af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.323817 May 13 13:28:09.323298 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 221/420] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:08 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:28:09.845754 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8f2e3428-bcca-496f-9387-72b9dc67bc27 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "POST /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.237746 May 13 13:28:09.859040 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 200/421] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:28:08 2022] POST /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353/os-volume_attachments => generated 194 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:10.345040 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ffc7543e-cdb3-4dd4-adb3-4b2d4b5b6ec9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:10.359019 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ffc7543e-cdb3-4dd4-adb3-4b2d4b5b6ec9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:10.380061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ffc7543e-cdb3-4dd4-adb3-4b2d4b5b6ec9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:10.381863 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ffc7543e-cdb3-4dd4-adb3-4b2d4b5b6ec9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:10.385375 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ffc7543e-cdb3-4dd4-adb3-4b2d4b5b6ec9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:10.386255 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ffc7543e-cdb3-4dd4-adb3-4b2d4b5b6ec9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:10.974361 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ffc7543e-cdb3-4dd4-adb3-4b2d4b5b6ec9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:10.999874 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ffc7543e-cdb3-4dd4-adb3-4b2d4b5b6ec9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:11.001398 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ffc7543e-cdb3-4dd4-adb3-4b2d4b5b6ec9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:11.018084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ffc7543e-cdb3-4dd4-adb3-4b2d4b5b6ec9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.680119 May 13 13:28:11.019091 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 222/422] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:10 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:12.037992 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6294340e-00ba-4a21-93fc-b93823f3b478 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:12.039251 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6294340e-00ba-4a21-93fc-b93823f3b478 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:12.055564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6294340e-00ba-4a21-93fc-b93823f3b478 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.059785 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6294340e-00ba-4a21-93fc-b93823f3b478 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.064881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6294340e-00ba-4a21-93fc-b93823f3b478 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:12.064881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6294340e-00ba-4a21-93fc-b93823f3b478 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:12.459952 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6294340e-00ba-4a21-93fc-b93823f3b478 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:12.471647 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6294340e-00ba-4a21-93fc-b93823f3b478 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:12.473162 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6294340e-00ba-4a21-93fc-b93823f3b478 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:12.476730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6294340e-00ba-4a21-93fc-b93823f3b478 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.443736 May 13 13:28:12.479684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 201/423] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:12 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:13.507002 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a63c782a-6ba1-49d0-8b47-aa1187d38d1f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:13.508218 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a63c782a-6ba1-49d0-8b47-aa1187d38d1f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:13.514919 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a63c782a-6ba1-49d0-8b47-aa1187d38d1f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:13.515363 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a63c782a-6ba1-49d0-8b47-aa1187d38d1f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:13.516148 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a63c782a-6ba1-49d0-8b47-aa1187d38d1f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:13.516580 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a63c782a-6ba1-49d0-8b47-aa1187d38d1f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:13.708756 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a63c782a-6ba1-49d0-8b47-aa1187d38d1f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:13.730447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a63c782a-6ba1-49d0-8b47-aa1187d38d1f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:13.740257 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a63c782a-6ba1-49d0-8b47-aa1187d38d1f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:13.747870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a63c782a-6ba1-49d0-8b47-aa1187d38d1f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.245108 May 13 13:28:13.753831 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 223/424] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:13 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:14.767878 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-78d3acbb-b331-444a-acb3-5427d5f1b69f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:14.769304 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-78d3acbb-b331-444a-acb3-5427d5f1b69f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:14.796161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-78d3acbb-b331-444a-acb3-5427d5f1b69f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:14.801983 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-78d3acbb-b331-444a-acb3-5427d5f1b69f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:14.805667 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-78d3acbb-b331-444a-acb3-5427d5f1b69f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:14.809335 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-78d3acbb-b331-444a-acb3-5427d5f1b69f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:15.107078 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-78d3acbb-b331-444a-acb3-5427d5f1b69f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:15.124687 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-78d3acbb-b331-444a-acb3-5427d5f1b69f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:15.128486 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-78d3acbb-b331-444a-acb3-5427d5f1b69f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:15.135488 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-78d3acbb-b331-444a-acb3-5427d5f1b69f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.368889 May 13 13:28:15.142168 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 202/425] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:14 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:15.296889 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-483836946", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:15.412318 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] validate_networks() for None {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:28:15.823323 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:28:15.823951 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:28:15.824521 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:28:15.825012 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:28:15.826433 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:28:15.844411 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:15.845196 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:15.846268 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:15.847130 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:15.880369 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Getting quotas for project cf41675800ef4cea9d8865f15ea46d2e. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:28:15.885042 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Getting quotas for user 68ac38391eab4eb99a6db0c2fd0b6b1f and project cf41675800ef4cea9d8865f15ea46d2e. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:28:15.900924 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:28:15.903272 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:28:16.044042 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2651dbba-5660-42ea-878a-8eaafbda5fd4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751565 May 13 13:28:16.045008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 224/426] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:28:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:28:16.066834 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2da36688-f44d-4a19-81f0-50063098ecbe tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:16.068680 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2da36688-f44d-4a19-81f0-50063098ecbe tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:16.158990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-17f3ebfd-003d-4a7d-a1e1-66ac027098c1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:16.159905 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-17f3ebfd-003d-4a7d-a1e1-66ac027098c1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:16.169645 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-17f3ebfd-003d-4a7d-a1e1-66ac027098c1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:16.172813 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-17f3ebfd-003d-4a7d-a1e1-66ac027098c1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:16.176946 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-17f3ebfd-003d-4a7d-a1e1-66ac027098c1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:16.176946 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-17f3ebfd-003d-4a7d-a1e1-66ac027098c1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:16.225396 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2da36688-f44d-4a19-81f0-50063098ecbe tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:16.232763 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2da36688-f44d-4a19-81f0-50063098ecbe tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1214 microversion: 2.1 time: 0.175221 May 13 13:28:16.246325 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 203/427] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:16 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:16.377528 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-17f3ebfd-003d-4a7d-a1e1-66ac027098c1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:16.391208 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-17f3ebfd-003d-4a7d-a1e1-66ac027098c1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:16.393986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-17f3ebfd-003d-4a7d-a1e1-66ac027098c1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:16.396007 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-17f3ebfd-003d-4a7d-a1e1-66ac027098c1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.242428 May 13 13:28:16.397064 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 225/428] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:16 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:17.255523 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-80165fd7-40e2-4475-9eaa-b33647a69748 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:17.256155 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-80165fd7-40e2-4475-9eaa-b33647a69748 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:17.408537 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-80165fd7-40e2-4475-9eaa-b33647a69748 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:17.417807 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-33c8f010-3a30-4210-aa88-3e3ce6437b76 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:17.419239 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-80165fd7-40e2-4475-9eaa-b33647a69748 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1214 microversion: 2.1 time: 0.169055 May 13 13:28:17.419392 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-33c8f010-3a30-4210-aa88-3e3ce6437b76 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:17.431697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-33c8f010-3a30-4210-aa88-3e3ce6437b76 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:17.431697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-33c8f010-3a30-4210-aa88-3e3ce6437b76 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:17.432839 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 204/429] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:17 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:17.440346 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-33c8f010-3a30-4210-aa88-3e3ce6437b76 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:17.441047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-33c8f010-3a30-4210-aa88-3e3ce6437b76 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:17.643300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-33c8f010-3a30-4210-aa88-3e3ce6437b76 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:17.657917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-33c8f010-3a30-4210-aa88-3e3ce6437b76 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:17.665957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-33c8f010-3a30-4210-aa88-3e3ce6437b76 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:17.665957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-33c8f010-3a30-4210-aa88-3e3ce6437b76 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.250202 May 13 13:28:17.665957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 226/430] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:17 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:28:18.442324 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-66fadc2b-2d3a-4b86-9bf4-52685ba70abf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:18.444329 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-66fadc2b-2d3a-4b86-9bf4-52685ba70abf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:18.464148 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-66fadc2b-2d3a-4b86-9bf4-52685ba70abf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:18.466804 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-66fadc2b-2d3a-4b86-9bf4-52685ba70abf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:18.470489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-66fadc2b-2d3a-4b86-9bf4-52685ba70abf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:18.470951 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-66fadc2b-2d3a-4b86-9bf4-52685ba70abf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:18.578744 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-66fadc2b-2d3a-4b86-9bf4-52685ba70abf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:18.586513 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-66fadc2b-2d3a-4b86-9bf4-52685ba70abf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1210 microversion: 2.1 time: 0.153326 May 13 13:28:18.606368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 205/431] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:18 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1210 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:18.680309 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-94088014-a5d1-46da-a73d-82dd3f7da0ae tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:18.682487 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-94088014-a5d1-46da-a73d-82dd3f7da0ae tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:18.691879 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-94088014-a5d1-46da-a73d-82dd3f7da0ae tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:18.694127 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-94088014-a5d1-46da-a73d-82dd3f7da0ae tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:18.694327 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-94088014-a5d1-46da-a73d-82dd3f7da0ae tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:18.694751 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-94088014-a5d1-46da-a73d-82dd3f7da0ae tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:18.860297 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-94088014-a5d1-46da-a73d-82dd3f7da0ae tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:18.876956 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-94088014-a5d1-46da-a73d-82dd3f7da0ae tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:18.876956 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-94088014-a5d1-46da-a73d-82dd3f7da0ae tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:18.876956 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-94088014-a5d1-46da-a73d-82dd3f7da0ae tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.198550 May 13 13:28:18.893473 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 227/432] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:18 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:19.613541 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1727315c-8618-4a2c-908b-eaab889ac757 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:19.614783 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1727315c-8618-4a2c-908b-eaab889ac757 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:19.624221 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1727315c-8618-4a2c-908b-eaab889ac757 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:19.630402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1727315c-8618-4a2c-908b-eaab889ac757 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:19.632745 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1727315c-8618-4a2c-908b-eaab889ac757 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:19.633434 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1727315c-8618-4a2c-908b-eaab889ac757 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:19.823691 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1727315c-8618-4a2c-908b-eaab889ac757 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:19.841626 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1727315c-8618-4a2c-908b-eaab889ac757 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1274 microversion: 2.1 time: 0.231706 May 13 13:28:19.843491 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 206/433] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:19 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1274 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:19.913125 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7adfeeff-789e-4c65-9a71-0c0caafb24e1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:19.913942 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7adfeeff-789e-4c65-9a71-0c0caafb24e1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:19.921979 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7adfeeff-789e-4c65-9a71-0c0caafb24e1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:19.922631 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7adfeeff-789e-4c65-9a71-0c0caafb24e1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:19.924769 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7adfeeff-789e-4c65-9a71-0c0caafb24e1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:19.925398 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7adfeeff-789e-4c65-9a71-0c0caafb24e1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:20.266782 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7adfeeff-789e-4c65-9a71-0c0caafb24e1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:20.280837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7adfeeff-789e-4c65-9a71-0c0caafb24e1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:20.290784 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7adfeeff-789e-4c65-9a71-0c0caafb24e1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:20.291991 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7adfeeff-789e-4c65-9a71-0c0caafb24e1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.383942 May 13 13:28:20.298504 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 228/434] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:19 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:20.860791 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-88337166-ab82-4131-b3ed-b6579a1547e5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:20.861644 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-88337166-ab82-4131-b3ed-b6579a1547e5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:20.882122 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-88337166-ab82-4131-b3ed-b6579a1547e5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:20.882746 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-88337166-ab82-4131-b3ed-b6579a1547e5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:20.883606 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-88337166-ab82-4131-b3ed-b6579a1547e5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:20.887292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-88337166-ab82-4131-b3ed-b6579a1547e5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:21.042701 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-88337166-ab82-4131-b3ed-b6579a1547e5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:21.063114 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-88337166-ab82-4131-b3ed-b6579a1547e5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1272 microversion: 2.1 time: 0.195245 May 13 13:28:21.077735 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 207/435] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:20 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:21.318692 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6695096b-9169-49aa-8609-ba7e62bf0c84 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:21.319998 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6695096b-9169-49aa-8609-ba7e62bf0c84 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:21.332026 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6695096b-9169-49aa-8609-ba7e62bf0c84 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:21.334371 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6695096b-9169-49aa-8609-ba7e62bf0c84 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:21.334371 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6695096b-9169-49aa-8609-ba7e62bf0c84 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:21.334371 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6695096b-9169-49aa-8609-ba7e62bf0c84 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:21.384823 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-d4bbcf90-ff01-4bf0-9de3-ace8151e31c1 req-a096d6bd-9d61-4766-a1d1-464588ea719b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89412841-b653-4a80-8cde-0c7a264a9c4c", "name": "network-vif-plugged", "status": "completed", "tag": "1a4cef43-4ad0-41f0-9857-11ea57340642"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:21.398819 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-d4bbcf90-ff01-4bf0-9de3-ace8151e31c1 req-a096d6bd-9d61-4766-a1d1-464588ea719b service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:21.407631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-d4bbcf90-ff01-4bf0-9de3-ace8151e31c1 req-a096d6bd-9d61-4766-a1d1-464588ea719b service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:21.442153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-d4bbcf90-ff01-4bf0-9de3-ace8151e31c1 req-a096d6bd-9d61-4766-a1d1-464588ea719b service nova] Creating event network-vif-plugged:1a4cef43-4ad0-41f0-9857-11ea57340642 for instance 89412841-b653-4a80-8cde-0c7a264a9c4c on hv-cinder-84159 May 13 13:28:21.463315 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-d4bbcf90-ff01-4bf0-9de3-ace8151e31c1 req-a096d6bd-9d61-4766-a1d1-464588ea719b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076901 May 13 13:28:21.464217 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 208/436] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:21.706363 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6695096b-9169-49aa-8609-ba7e62bf0c84 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:21.706363 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6695096b-9169-49aa-8609-ba7e62bf0c84 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:21.706739 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6695096b-9169-49aa-8609-ba7e62bf0c84 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:21.706739 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6695096b-9169-49aa-8609-ba7e62bf0c84 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.367347 May 13 13:28:21.706739 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 229/437] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:21 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:22.078243 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-550a051b-32a8-43d7-b833-8b96a5bc4a1d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:22.080138 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-550a051b-32a8-43d7-b833-8b96a5bc4a1d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:22.092797 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-550a051b-32a8-43d7-b833-8b96a5bc4a1d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:22.099006 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-550a051b-32a8-43d7-b833-8b96a5bc4a1d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:22.101264 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-550a051b-32a8-43d7-b833-8b96a5bc4a1d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:22.103273 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-550a051b-32a8-43d7-b833-8b96a5bc4a1d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:22.367956 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-550a051b-32a8-43d7-b833-8b96a5bc4a1d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:22.379106 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-550a051b-32a8-43d7-b833-8b96a5bc4a1d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.306258 May 13 13:28:22.382846 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 209/438] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:22 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:22.702410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-976ac2da-f89f-4c69-aded-f1a0573372f1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:22.703829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-976ac2da-f89f-4c69-aded-f1a0573372f1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:22.716582 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-976ac2da-f89f-4c69-aded-f1a0573372f1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:22.717821 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-976ac2da-f89f-4c69-aded-f1a0573372f1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:22.719031 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-976ac2da-f89f-4c69-aded-f1a0573372f1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:22.719691 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-976ac2da-f89f-4c69-aded-f1a0573372f1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:23.022210 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-976ac2da-f89f-4c69-aded-f1a0573372f1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:23.033517 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-976ac2da-f89f-4c69-aded-f1a0573372f1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:23.035502 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-976ac2da-f89f-4c69-aded-f1a0573372f1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:23.038105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-976ac2da-f89f-4c69-aded-f1a0573372f1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.340444 May 13 13:28:23.042998 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 230/439] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:22 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:23.400528 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d3acc48c-9fa7-46a6-8b7d-03e7ff5bbd87 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:23.401236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d3acc48c-9fa7-46a6-8b7d-03e7ff5bbd87 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:23.457074 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d3acc48c-9fa7-46a6-8b7d-03e7ff5bbd87 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:23.485259 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d3acc48c-9fa7-46a6-8b7d-03e7ff5bbd87 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:23.486269 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d3acc48c-9fa7-46a6-8b7d-03e7ff5bbd87 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:23.486855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d3acc48c-9fa7-46a6-8b7d-03e7ff5bbd87 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:23.761533 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d3acc48c-9fa7-46a6-8b7d-03e7ff5bbd87 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:23.780154 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d3acc48c-9fa7-46a6-8b7d-03e7ff5bbd87 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.384710 May 13 13:28:23.781767 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 210/440] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:23 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:24.061021 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3c073cfa-cbcd-428e-9f4f-4fb988da95fc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:24.061743 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3c073cfa-cbcd-428e-9f4f-4fb988da95fc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:24.086319 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c073cfa-cbcd-428e-9f4f-4fb988da95fc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:24.086781 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c073cfa-cbcd-428e-9f4f-4fb988da95fc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:24.098030 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c073cfa-cbcd-428e-9f4f-4fb988da95fc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:24.098030 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3c073cfa-cbcd-428e-9f4f-4fb988da95fc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:24.776408 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3c073cfa-cbcd-428e-9f4f-4fb988da95fc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:24.789622 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3c073cfa-cbcd-428e-9f4f-4fb988da95fc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:24.792773 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3c073cfa-cbcd-428e-9f4f-4fb988da95fc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:24.795728 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3c073cfa-cbcd-428e-9f4f-4fb988da95fc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.738923 May 13 13:28:24.799734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-524be5b9-2db4-4282-8133-239e6bbae0c4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:24.799734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-524be5b9-2db4-4282-8133-239e6bbae0c4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:24.800798 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 231/441] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:24 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:24.806532 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-524be5b9-2db4-4282-8133-239e6bbae0c4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:24.808571 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-524be5b9-2db4-4282-8133-239e6bbae0c4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:24.811257 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-524be5b9-2db4-4282-8133-239e6bbae0c4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:24.813553 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-524be5b9-2db4-4282-8133-239e6bbae0c4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:25.104690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-524be5b9-2db4-4282-8133-239e6bbae0c4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:25.130281 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-524be5b9-2db4-4282-8133-239e6bbae0c4 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.335608 May 13 13:28:25.132559 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 211/442] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:24 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:25.266228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-0743688c-c55c-4548-b42f-1bfa2e8550b8 req-98921c6d-0165-467f-8ef3-a5c8842df499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5917161-6578-4060-bd1e-2d9a71038c11", "tag": "e84251c9-c1ff-42fe-90fb-e8740154bb18"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:25.283042 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-0743688c-c55c-4548-b42f-1bfa2e8550b8 req-98921c6d-0165-467f-8ef3-a5c8842df499 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:25.283743 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-0743688c-c55c-4548-b42f-1bfa2e8550b8 req-98921c6d-0165-467f-8ef3-a5c8842df499 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:25.326324 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-0743688c-c55c-4548-b42f-1bfa2e8550b8 req-98921c6d-0165-467f-8ef3-a5c8842df499 service nova] Creating event network-changed:e84251c9-c1ff-42fe-90fb-e8740154bb18 for instance e5917161-6578-4060-bd1e-2d9a71038c11 on hv-cinder-84159 May 13 13:28:25.342895 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-0743688c-c55c-4548-b42f-1bfa2e8550b8 req-98921c6d-0165-467f-8ef3-a5c8842df499 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088105 May 13 13:28:25.381196 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 232/443] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:28:25.822091 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c93fba2e-139e-466a-9e01-59f025ea13eb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:25.823465 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c93fba2e-139e-466a-9e01-59f025ea13eb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:25.838711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c93fba2e-139e-466a-9e01-59f025ea13eb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:25.841125 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c93fba2e-139e-466a-9e01-59f025ea13eb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:25.851297 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c93fba2e-139e-466a-9e01-59f025ea13eb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:25.852122 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c93fba2e-139e-466a-9e01-59f025ea13eb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:26.077257 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c93fba2e-139e-466a-9e01-59f025ea13eb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:26.088008 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c93fba2e-139e-466a-9e01-59f025ea13eb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:26.089837 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c93fba2e-139e-466a-9e01-59f025ea13eb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:26.099235 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c93fba2e-139e-466a-9e01-59f025ea13eb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.278556 May 13 13:28:26.100521 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 212/444] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:25 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:26.166135 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e427b0ef-0637-483b-8272-ef05b4c82e46 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:26.167293 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e427b0ef-0637-483b-8272-ef05b4c82e46 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:26.176025 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e427b0ef-0637-483b-8272-ef05b4c82e46 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:26.176764 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e427b0ef-0637-483b-8272-ef05b4c82e46 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:26.178034 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e427b0ef-0637-483b-8272-ef05b4c82e46 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:26.185139 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e427b0ef-0637-483b-8272-ef05b4c82e46 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:26.363016 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e427b0ef-0637-483b-8272-ef05b4c82e46 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:26.372574 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e427b0ef-0637-483b-8272-ef05b4c82e46 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.217095 May 13 13:28:26.374311 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 233/445] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:26 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:27.118562 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f2ac99f7-9b5b-4e10-8d9c-d765edd68581 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:27.119985 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f2ac99f7-9b5b-4e10-8d9c-d765edd68581 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:27.128428 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f2ac99f7-9b5b-4e10-8d9c-d765edd68581 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:27.129046 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f2ac99f7-9b5b-4e10-8d9c-d765edd68581 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:27.129994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f2ac99f7-9b5b-4e10-8d9c-d765edd68581 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:27.130579 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f2ac99f7-9b5b-4e10-8d9c-d765edd68581 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:27.375978 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f2ac99f7-9b5b-4e10-8d9c-d765edd68581 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:27.387113 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f2ac99f7-9b5b-4e10-8d9c-d765edd68581 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:27.389498 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f2ac99f7-9b5b-4e10-8d9c-d765edd68581 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:27.390950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f2ac99f7-9b5b-4e10-8d9c-d765edd68581 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.276369 May 13 13:28:27.391988 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 213/446] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:27 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:27.393247 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-935bc32b-e1b5-456c-b7d3-160c449c0739 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:27.394205 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-935bc32b-e1b5-456c-b7d3-160c449c0739 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:27.411674 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-935bc32b-e1b5-456c-b7d3-160c449c0739 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:27.412579 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-935bc32b-e1b5-456c-b7d3-160c449c0739 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:27.413600 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-935bc32b-e1b5-456c-b7d3-160c449c0739 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:27.417266 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-935bc32b-e1b5-456c-b7d3-160c449c0739 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:27.574767 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-935bc32b-e1b5-456c-b7d3-160c449c0739 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:27.585412 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-935bc32b-e1b5-456c-b7d3-160c449c0739 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.197513 May 13 13:28:27.586117 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 234/447] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:27 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:28.422373 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-dd1f2aae-4d81-4aa6-8c91-f9c6f86e8061 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:28.423086 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-dd1f2aae-4d81-4aa6-8c91-f9c6f86e8061 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:28.431310 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dd1f2aae-4d81-4aa6-8c91-f9c6f86e8061 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:28.432060 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dd1f2aae-4d81-4aa6-8c91-f9c6f86e8061 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:28.433196 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dd1f2aae-4d81-4aa6-8c91-f9c6f86e8061 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:28.433870 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dd1f2aae-4d81-4aa6-8c91-f9c6f86e8061 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:28.579982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-dd1f2aae-4d81-4aa6-8c91-f9c6f86e8061 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:28.588416 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-dd1f2aae-4d81-4aa6-8c91-f9c6f86e8061 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:28.605299 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-dd1f2aae-4d81-4aa6-8c91-f9c6f86e8061 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:28.605299 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-dd1f2aae-4d81-4aa6-8c91-f9c6f86e8061 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.173162 May 13 13:28:28.605299 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 214/448] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:28 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:28.606366 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fa9559c1-5497-4831-a85d-a8fef902792a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:28.606983 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fa9559c1-5497-4831-a85d-a8fef902792a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:28.612896 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fa9559c1-5497-4831-a85d-a8fef902792a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:28.613548 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fa9559c1-5497-4831-a85d-a8fef902792a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:28.614391 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fa9559c1-5497-4831-a85d-a8fef902792a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:28.614777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fa9559c1-5497-4831-a85d-a8fef902792a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:28.760206 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fa9559c1-5497-4831-a85d-a8fef902792a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:28.768728 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fa9559c1-5497-4831-a85d-a8fef902792a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.166223 May 13 13:28:28.771125 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 235/449] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:28 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:29.621985 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-961934a3-3bc4-46b0-9b10-2962b029a1c6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:29.622740 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-961934a3-3bc4-46b0-9b10-2962b029a1c6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:29.629910 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-961934a3-3bc4-46b0-9b10-2962b029a1c6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:29.630591 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-961934a3-3bc4-46b0-9b10-2962b029a1c6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:29.631547 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-961934a3-3bc4-46b0-9b10-2962b029a1c6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:29.632152 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-961934a3-3bc4-46b0-9b10-2962b029a1c6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:29.786583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-49b00b00-7625-4386-847b-7164266c5696 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:29.787902 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-49b00b00-7625-4386-847b-7164266c5696 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:29.794455 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49b00b00-7625-4386-847b-7164266c5696 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:29.795721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49b00b00-7625-4386-847b-7164266c5696 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:29.796771 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49b00b00-7625-4386-847b-7164266c5696 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:29.797397 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-49b00b00-7625-4386-847b-7164266c5696 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:29.974911 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-49b00b00-7625-4386-847b-7164266c5696 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:29.977025 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-49b00b00-7625-4386-847b-7164266c5696 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.193783 May 13 13:28:29.981834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 236/450] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:29 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:30.036245 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-961934a3-3bc4-46b0-9b10-2962b029a1c6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:30.045122 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-961934a3-3bc4-46b0-9b10-2962b029a1c6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:30.046679 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-961934a3-3bc4-46b0-9b10-2962b029a1c6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:30.047910 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-961934a3-3bc4-46b0-9b10-2962b029a1c6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.430040 May 13 13:28:30.059784 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 215/451] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:29 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:30.994846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f18e9a34-1b98-4d5f-a7ef-16204facbcea tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:30.995550 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f18e9a34-1b98-4d5f-a7ef-16204facbcea tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:31.008254 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f18e9a34-1b98-4d5f-a7ef-16204facbcea tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:31.008931 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f18e9a34-1b98-4d5f-a7ef-16204facbcea tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:31.014379 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f18e9a34-1b98-4d5f-a7ef-16204facbcea tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:31.014379 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f18e9a34-1b98-4d5f-a7ef-16204facbcea tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:31.067125 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-493d0af9-c33c-4622-95c7-65b11d423992 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:31.068372 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-493d0af9-c33c-4622-95c7-65b11d423992 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:31.075821 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-493d0af9-c33c-4622-95c7-65b11d423992 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:31.076970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-493d0af9-c33c-4622-95c7-65b11d423992 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:31.077474 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-493d0af9-c33c-4622-95c7-65b11d423992 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:31.078128 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-493d0af9-c33c-4622-95c7-65b11d423992 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:31.185845 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f18e9a34-1b98-4d5f-a7ef-16204facbcea tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:31.193770 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f18e9a34-1b98-4d5f-a7ef-16204facbcea tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.203207 May 13 13:28:31.201600 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 237/452] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:30 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:31.242944 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-493d0af9-c33c-4622-95c7-65b11d423992 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:31.252364 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-493d0af9-c33c-4622-95c7-65b11d423992 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:31.254298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-493d0af9-c33c-4622-95c7-65b11d423992 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:31.255639 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-493d0af9-c33c-4622-95c7-65b11d423992 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.192463 May 13 13:28:31.256277 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 216/453] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:31 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:32.211636 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c6e59f4f-beeb-49f0-9894-4de54a03504c tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:32.212287 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c6e59f4f-beeb-49f0-9894-4de54a03504c tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:32.218624 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c6e59f4f-beeb-49f0-9894-4de54a03504c tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:32.219449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c6e59f4f-beeb-49f0-9894-4de54a03504c tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:32.220395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c6e59f4f-beeb-49f0-9894-4de54a03504c tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:32.220708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c6e59f4f-beeb-49f0-9894-4de54a03504c tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:32.278030 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ae942b97-0df8-41cb-bc4b-d8dffdb61a46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:32.282882 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ae942b97-0df8-41cb-bc4b-d8dffdb61a46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:32.285173 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ae942b97-0df8-41cb-bc4b-d8dffdb61a46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:32.285635 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ae942b97-0df8-41cb-bc4b-d8dffdb61a46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:32.286460 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ae942b97-0df8-41cb-bc4b-d8dffdb61a46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:32.286911 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ae942b97-0df8-41cb-bc4b-d8dffdb61a46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:32.355836 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c6e59f4f-beeb-49f0-9894-4de54a03504c tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:32.364300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c6e59f4f-beeb-49f0-9894-4de54a03504c tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.156473 May 13 13:28:32.364885 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 238/454] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:32 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:32.422328 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ae942b97-0df8-41cb-bc4b-d8dffdb61a46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:32.431759 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ae942b97-0df8-41cb-bc4b-d8dffdb61a46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:32.433341 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ae942b97-0df8-41cb-bc4b-d8dffdb61a46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:32.434528 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ae942b97-0df8-41cb-bc4b-d8dffdb61a46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.162100 May 13 13:28:32.435116 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 217/455] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:32 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:28:32.752314 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-75e2625d-ace8-4d3f-b338-fafcae71d9ad tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Action: 'create', calling method: .version_select at 0x7faaa1ea75e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-568186673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuyB8bX/5UC/Abr3eJFQ64Jwsh6eZwFTyUWUaNW+SraNYL93MvE67oVTN8eIgn2kPARGW1L3Qe22XML7NSJnkBl1z3Q7t98ySQUCB1cajzr+hbIwCocomMTZSR8qWYSMA=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:32.765833 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-75e2625d-ace8-4d3f-b338-fafcae71d9ad tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Getting quotas for project 1503b2654ff7475b98032519919ae481. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:28:32.770133 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-75e2625d-ace8-4d3f-b338-fafcae71d9ad tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Getting quotas for user 015fce3883ab4ee0960565c1a51f520d and project 1503b2654ff7475b98032519919ae481. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:28:32.837354 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-75e2625d-ace8-4d3f-b338-fafcae71d9ad tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.088720 May 13 13:28:32.838161 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 239/456] 10.222.0.25 () {60 vars in 1158 bytes} [Fri May 13 13:28:32 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:32.885180 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-729624102", "imageRef": "00187b80-42fa-4e30-ab34-f4e9033cbff6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-568186673", "networks": [{"uuid": "235bca42-800d-41b0-b0e6-b3de898d8caa"}]}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:32.934991 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.network.neutron [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] validate_networks() for [('235bca42-800d-41b0-b0e6-b3de898d8caa', None, None, None, None, None)] {{(pid=117602) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:28:33.306359 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Flavor limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:28:33.306983 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Image limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:28:33.307288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Flavor pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:28:33.307701 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Image pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:28:33.308150 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:28:33.317299 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:33.317757 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:33.318597 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:33.319038 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:33.336119 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Getting quotas for project 1503b2654ff7475b98032519919ae481. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:28:33.340033 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Getting quotas for user 015fce3883ab4ee0960565c1a51f520d and project 1503b2654ff7475b98032519919ae481. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:28:33.350773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Going to run 1 instances... {{(pid=117602) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:28:33.352972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='00187b80-42fa-4e30-ab34-f4e9033cbff6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:28:33.381906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1917e6e5-b1d8-4e4f-9c5d-6837763f5793 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:33.382527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1917e6e5-b1d8-4e4f-9c5d-6837763f5793 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:33.388511 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1917e6e5-b1d8-4e4f-9c5d-6837763f5793 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:33.389602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1917e6e5-b1d8-4e4f-9c5d-6837763f5793 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:33.390443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1917e6e5-b1d8-4e4f-9c5d-6837763f5793 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:33.390893 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1917e6e5-b1d8-4e4f-9c5d-6837763f5793 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:33.527477 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1917e6e5-b1d8-4e4f-9c5d-6837763f5793 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:33.534938 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1917e6e5-b1d8-4e4f-9c5d-6837763f5793 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.157035 May 13 13:28:33.535479 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 240/457] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:33 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:33.539782 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5c5d0f46-f5f7-4e2c-b3cf-af94df73eed2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:33.540479 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5c5d0f46-f5f7-4e2c-b3cf-af94df73eed2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:33.547171 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c5d0f46-f5f7-4e2c-b3cf-af94df73eed2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:33.547630 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c5d0f46-f5f7-4e2c-b3cf-af94df73eed2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:33.548399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c5d0f46-f5f7-4e2c-b3cf-af94df73eed2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:33.548833 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c5d0f46-f5f7-4e2c-b3cf-af94df73eed2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:33.557011 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a061fac7-550c-40cd-aacf-c87120240fc7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675509 May 13 13:28:33.557891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 218/458] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:28:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:28:33.571834 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-08a6bac1-09fe-4415-9bfd-53e7a65a2af8 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:33.572453 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-08a6bac1-09fe-4415-9bfd-53e7a65a2af8 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:33.635616 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-08a6bac1-09fe-4415-9bfd-53e7a65a2af8 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:33.643686 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-08a6bac1-09fe-4415-9bfd-53e7a65a2af8 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1257 microversion: 2.1 time: 0.079596 May 13 13:28:33.649514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 219/459] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:33 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1257 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:33.698829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5c5d0f46-f5f7-4e2c-b3cf-af94df73eed2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:33.709809 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5c5d0f46-f5f7-4e2c-b3cf-af94df73eed2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:33.709809 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5c5d0f46-f5f7-4e2c-b3cf-af94df73eed2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:33.710803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5c5d0f46-f5f7-4e2c-b3cf-af94df73eed2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1808 microversion: 2.20 time: 0.174428 May 13 13:28:33.711358 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 241/460] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:33 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:34.554947 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-92f8938d-ed31-418f-8a9b-64a2e3a9ca62 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:34.555626 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-92f8938d-ed31-418f-8a9b-64a2e3a9ca62 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:34.561918 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-92f8938d-ed31-418f-8a9b-64a2e3a9ca62 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:34.562377 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-92f8938d-ed31-418f-8a9b-64a2e3a9ca62 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:34.563159 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-92f8938d-ed31-418f-8a9b-64a2e3a9ca62 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:34.563602 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-92f8938d-ed31-418f-8a9b-64a2e3a9ca62 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:34.661209 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7e18678f-0d3e-47c7-979c-dd27f6898978 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:34.662018 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7e18678f-0d3e-47c7-979c-dd27f6898978 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:34.718085 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-92f8938d-ed31-418f-8a9b-64a2e3a9ca62 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:34.719038 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7e18678f-0d3e-47c7-979c-dd27f6898978 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:34.725716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-92f8938d-ed31-418f-8a9b-64a2e3a9ca62 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.175535 May 13 13:28:34.726329 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 220/461] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:34 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:34.727138 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7e18678f-0d3e-47c7-979c-dd27f6898978 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1257 microversion: 2.1 time: 0.069911 May 13 13:28:34.736558 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 242/462] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:34 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:34.736745 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f830b179-3859-43cf-8572-d4562db372e5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:34.736745 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f830b179-3859-43cf-8572-d4562db372e5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:34.737697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f830b179-3859-43cf-8572-d4562db372e5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:34.738182 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f830b179-3859-43cf-8572-d4562db372e5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:34.738955 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f830b179-3859-43cf-8572-d4562db372e5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:34.739393 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f830b179-3859-43cf-8572-d4562db372e5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:34.874685 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f830b179-3859-43cf-8572-d4562db372e5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:34.882820 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f830b179-3859-43cf-8572-d4562db372e5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:34.884305 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f830b179-3859-43cf-8572-d4562db372e5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:34.885530 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f830b179-3859-43cf-8572-d4562db372e5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1795 microversion: 2.20 time: 0.158124 May 13 13:28:34.889716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 221/463] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:28:34 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:28:35.742544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2f212269-0d73-441b-a89d-52a21bf82318 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:35.743293 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2f212269-0d73-441b-a89d-52a21bf82318 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:35.745810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a06d5411-9596-4330-88a3-ec4985e94a34 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:35.746959 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a06d5411-9596-4330-88a3-ec4985e94a34 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:35.749531 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f212269-0d73-441b-a89d-52a21bf82318 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:35.750079 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f212269-0d73-441b-a89d-52a21bf82318 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:35.750931 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f212269-0d73-441b-a89d-52a21bf82318 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:35.751456 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2f212269-0d73-441b-a89d-52a21bf82318 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:35.754591 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a06d5411-9596-4330-88a3-ec4985e94a34 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:35.755279 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a06d5411-9596-4330-88a3-ec4985e94a34 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:35.756233 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a06d5411-9596-4330-88a3-ec4985e94a34 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:35.756782 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a06d5411-9596-4330-88a3-ec4985e94a34 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:35.827069 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a06d5411-9596-4330-88a3-ec4985e94a34 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:35.834786 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a06d5411-9596-4330-88a3-ec4985e94a34 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1309 microversion: 2.1 time: 0.093018 May 13 13:28:35.835346 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 222/464] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:35 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:35.897153 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2f212269-0d73-441b-a89d-52a21bf82318 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:35.905099 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2f212269-0d73-441b-a89d-52a21bf82318 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.165722 May 13 13:28:35.905668 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 243/465] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:35 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:36.852551 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2ec0d9ab-b59c-4da0-9087-03ea8ce6b612 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:36.853154 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2ec0d9ab-b59c-4da0-9087-03ea8ce6b612 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:36.860306 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2ec0d9ab-b59c-4da0-9087-03ea8ce6b612 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:36.866332 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2ec0d9ab-b59c-4da0-9087-03ea8ce6b612 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:36.866332 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2ec0d9ab-b59c-4da0-9087-03ea8ce6b612 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:36.866332 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2ec0d9ab-b59c-4da0-9087-03ea8ce6b612 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:36.921726 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ef3cd18d-2bd0-4891-8503-4357a42f7bbf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:36.922503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ef3cd18d-2bd0-4891-8503-4357a42f7bbf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:36.929708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ef3cd18d-2bd0-4891-8503-4357a42f7bbf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:36.932852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ef3cd18d-2bd0-4891-8503-4357a42f7bbf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:36.936129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ef3cd18d-2bd0-4891-8503-4357a42f7bbf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:36.937778 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ef3cd18d-2bd0-4891-8503-4357a42f7bbf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:37.126838 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2ec0d9ab-b59c-4da0-9087-03ea8ce6b612 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:37.138092 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2ec0d9ab-b59c-4da0-9087-03ea8ce6b612 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.289207 May 13 13:28:37.140114 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 223/466] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:36 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:37.197192 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ef3cd18d-2bd0-4891-8503-4357a42f7bbf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:37.209439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ef3cd18d-2bd0-4891-8503-4357a42f7bbf tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.291711 May 13 13:28:37.219222 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 244/467] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:36 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:37.347087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-34b66ccb-7014-4311-8142-2887e855ee22 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:37.348045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-34b66ccb-7014-4311-8142-2887e855ee22 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:37.355165 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-34b66ccb-7014-4311-8142-2887e855ee22 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:37.355921 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-34b66ccb-7014-4311-8142-2887e855ee22 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:37.357077 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-34b66ccb-7014-4311-8142-2887e855ee22 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:37.358430 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-34b66ccb-7014-4311-8142-2887e855ee22 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:37.522089 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-34b66ccb-7014-4311-8142-2887e855ee22 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lazy-loading 'services' on Instance uuid 48e0eae6-6c5f-446e-a5c3-bfccf382c353 {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:28:37.798101 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-34b66ccb-7014-4311-8142-2887e855ee22 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "DELETE /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353/os-volume_attachments/6354c144-44a3-4ea7-b43c-db5f87bb717c" status: 202 len: 0 microversion: 2.1 time: 0.456181 May 13 13:28:37.798678 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 224/468] 10.222.0.25 () {58 vars in 1415 bytes} [Fri May 13 13:28:37 2022] DELETE /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353/os-volume_attachments/6354c144-44a3-4ea7-b43c-db5f87bb717c => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:28:38.158292 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d351db49-7107-4254-a7ac-83c7d5509683 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:38.159779 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d351db49-7107-4254-a7ac-83c7d5509683 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:38.167536 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d351db49-7107-4254-a7ac-83c7d5509683 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:38.168702 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d351db49-7107-4254-a7ac-83c7d5509683 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:38.170260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d351db49-7107-4254-a7ac-83c7d5509683 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:38.170909 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d351db49-7107-4254-a7ac-83c7d5509683 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:38.228642 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-625444c1-b0d5-4d26-877a-83397fb133b3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:38.229489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-625444c1-b0d5-4d26-877a-83397fb133b3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:38.241484 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-625444c1-b0d5-4d26-877a-83397fb133b3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:38.242067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-625444c1-b0d5-4d26-877a-83397fb133b3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:38.242864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-625444c1-b0d5-4d26-877a-83397fb133b3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:38.243305 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-625444c1-b0d5-4d26-877a-83397fb133b3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:38.445239 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d351db49-7107-4254-a7ac-83c7d5509683 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:38.459197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d351db49-7107-4254-a7ac-83c7d5509683 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.304069 May 13 13:28:38.460588 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 245/469] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:38 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:38.550243 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-625444c1-b0d5-4d26-877a-83397fb133b3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:38.559212 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-625444c1-b0d5-4d26-877a-83397fb133b3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.335462 May 13 13:28:38.559896 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 225/470] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:38 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:38.718680 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-0f5e15ce-bb82-4bd8-935b-5eda5b15228d req-ddc05d9f-bfd2-445b-bb87-cb30b084f0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5917161-6578-4060-bd1e-2d9a71038c11", "name": "network-vif-plugged", "status": "completed", "tag": "e84251c9-c1ff-42fe-90fb-e8740154bb18"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:38.736923 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-0f5e15ce-bb82-4bd8-935b-5eda5b15228d req-ddc05d9f-bfd2-445b-bb87-cb30b084f0df service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:38.739361 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-0f5e15ce-bb82-4bd8-935b-5eda5b15228d req-ddc05d9f-bfd2-445b-bb87-cb30b084f0df service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:38.775373 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-0f5e15ce-bb82-4bd8-935b-5eda5b15228d req-ddc05d9f-bfd2-445b-bb87-cb30b084f0df service nova] Creating event network-vif-plugged:e84251c9-c1ff-42fe-90fb-e8740154bb18 for instance e5917161-6578-4060-bd1e-2d9a71038c11 on hv-cinder-84159 May 13 13:28:38.780862 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-0f5e15ce-bb82-4bd8-935b-5eda5b15228d req-ddc05d9f-bfd2-445b-bb87-cb30b084f0df service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066908 May 13 13:28:38.782009 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 246/471] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:39.476392 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6834f8d3-c8a4-452c-80c3-ef3a26269665 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:39.478418 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6834f8d3-c8a4-452c-80c3-ef3a26269665 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:39.486059 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6834f8d3-c8a4-452c-80c3-ef3a26269665 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:39.486852 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6834f8d3-c8a4-452c-80c3-ef3a26269665 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:39.487990 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6834f8d3-c8a4-452c-80c3-ef3a26269665 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:39.488726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6834f8d3-c8a4-452c-80c3-ef3a26269665 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:39.582604 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b3d715bc-de73-4260-a936-9a459bff7e20 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:39.583325 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b3d715bc-de73-4260-a936-9a459bff7e20 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:39.590633 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3d715bc-de73-4260-a936-9a459bff7e20 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:39.591104 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3d715bc-de73-4260-a936-9a459bff7e20 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:39.591931 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3d715bc-de73-4260-a936-9a459bff7e20 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:39.592377 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3d715bc-de73-4260-a936-9a459bff7e20 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:39.815572 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b3d715bc-de73-4260-a936-9a459bff7e20 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:39.825758 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b3d715bc-de73-4260-a936-9a459bff7e20 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.250447 May 13 13:28:39.829149 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 247/472] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:39 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:39.885012 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6834f8d3-c8a4-452c-80c3-ef3a26269665 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:39.892575 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6834f8d3-c8a4-452c-80c3-ef3a26269665 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.420074 May 13 13:28:39.893139 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 226/473] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:39 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:40.845649 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-be104bdf-702d-4ee6-aace-bece31b0dce3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:40.847721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-be104bdf-702d-4ee6-aace-bece31b0dce3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:40.854425 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-be104bdf-702d-4ee6-aace-bece31b0dce3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:40.855144 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-be104bdf-702d-4ee6-aace-bece31b0dce3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:40.861681 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-be104bdf-702d-4ee6-aace-bece31b0dce3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:40.862261 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-be104bdf-702d-4ee6-aace-bece31b0dce3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:40.910628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ed26957a-cffb-4b0c-aacb-57a0b32e1c1a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:40.911529 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ed26957a-cffb-4b0c-aacb-57a0b32e1c1a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:40.932457 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ed26957a-cffb-4b0c-aacb-57a0b32e1c1a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:40.933006 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ed26957a-cffb-4b0c-aacb-57a0b32e1c1a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:40.936431 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ed26957a-cffb-4b0c-aacb-57a0b32e1c1a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:40.938104 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ed26957a-cffb-4b0c-aacb-57a0b32e1c1a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:41.119688 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-be104bdf-702d-4ee6-aace-bece31b0dce3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:41.135084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-be104bdf-702d-4ee6-aace-bece31b0dce3 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.294111 May 13 13:28:41.136252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 248/474] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:40 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:41.246152 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ed26957a-cffb-4b0c-aacb-57a0b32e1c1a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:41.254764 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ed26957a-cffb-4b0c-aacb-57a0b32e1c1a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.348650 May 13 13:28:41.268114 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 227/475] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:40 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:42.152633 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-768fd109-75c5-4af8-bd6c-4a3eb9459164 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:42.153296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-768fd109-75c5-4af8-bd6c-4a3eb9459164 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:42.163006 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-768fd109-75c5-4af8-bd6c-4a3eb9459164 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:42.167894 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-768fd109-75c5-4af8-bd6c-4a3eb9459164 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:42.167894 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-768fd109-75c5-4af8-bd6c-4a3eb9459164 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:42.167894 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-768fd109-75c5-4af8-bd6c-4a3eb9459164 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:42.272095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-57a4be09-f222-4fb3-b86e-32d4a8c35ee0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:42.272714 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-57a4be09-f222-4fb3-b86e-32d4a8c35ee0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:42.279739 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-57a4be09-f222-4fb3-b86e-32d4a8c35ee0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:42.280479 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-57a4be09-f222-4fb3-b86e-32d4a8c35ee0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:42.281658 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-57a4be09-f222-4fb3-b86e-32d4a8c35ee0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:42.282349 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-57a4be09-f222-4fb3-b86e-32d4a8c35ee0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:42.503342 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-57a4be09-f222-4fb3-b86e-32d4a8c35ee0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:42.521990 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-57a4be09-f222-4fb3-b86e-32d4a8c35ee0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.248101 May 13 13:28:42.534036 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 228/476] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:42 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:42.539885 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-768fd109-75c5-4af8-bd6c-4a3eb9459164 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:42.552023 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-768fd109-75c5-4af8-bd6c-4a3eb9459164 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.399743 May 13 13:28:42.552862 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 249/477] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:42 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:43.551214 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d5afa6ea-5012-4b41-a1df-4f0365685003 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:43.553618 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d5afa6ea-5012-4b41-a1df-4f0365685003 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:43.562770 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d5afa6ea-5012-4b41-a1df-4f0365685003 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:43.563541 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d5afa6ea-5012-4b41-a1df-4f0365685003 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:43.571104 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-de122e07-1836-4d90-a861-1a1eb9e30ec2 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:43.572348 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-de122e07-1836-4d90-a861-1a1eb9e30ec2 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:43.578806 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d5afa6ea-5012-4b41-a1df-4f0365685003 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:43.580144 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d5afa6ea-5012-4b41-a1df-4f0365685003 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:43.583234 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-de122e07-1836-4d90-a861-1a1eb9e30ec2 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:43.587422 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-de122e07-1836-4d90-a861-1a1eb9e30ec2 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:43.588495 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-de122e07-1836-4d90-a861-1a1eb9e30ec2 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:43.589131 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-de122e07-1836-4d90-a861-1a1eb9e30ec2 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:43.820174 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d5afa6ea-5012-4b41-a1df-4f0365685003 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:43.829655 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d5afa6ea-5012-4b41-a1df-4f0365685003 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.294611 May 13 13:28:43.839102 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 229/478] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:43 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:43.938881 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-de122e07-1836-4d90-a861-1a1eb9e30ec2 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:43.952382 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-de122e07-1836-4d90-a861-1a1eb9e30ec2 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.385383 May 13 13:28:43.953224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 250/479] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:43 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:44.669862 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:28:44.669862 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Fri May 13 13:28:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:28:44.850157 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6da71d30-bbe6-4ca9-9440-63aaf8ec8fd6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:44.850157 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6da71d30-bbe6-4ca9-9440-63aaf8ec8fd6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:44.861022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6da71d30-bbe6-4ca9-9440-63aaf8ec8fd6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:44.861482 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6da71d30-bbe6-4ca9-9440-63aaf8ec8fd6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:44.863048 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6da71d30-bbe6-4ca9-9440-63aaf8ec8fd6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:44.863500 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6da71d30-bbe6-4ca9-9440-63aaf8ec8fd6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:44.971235 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-670c8d85-e698-4a7c-9fd2-be87b8733cc8 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:44.972531 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-670c8d85-e698-4a7c-9fd2-be87b8733cc8 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:44.984317 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-670c8d85-e698-4a7c-9fd2-be87b8733cc8 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:44.985870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-670c8d85-e698-4a7c-9fd2-be87b8733cc8 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:44.985870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-670c8d85-e698-4a7c-9fd2-be87b8733cc8 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:44.987147 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-670c8d85-e698-4a7c-9fd2-be87b8733cc8 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:45.089174 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6da71d30-bbe6-4ca9-9440-63aaf8ec8fd6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:45.097397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6da71d30-bbe6-4ca9-9440-63aaf8ec8fd6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.254565 May 13 13:28:45.098372 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 230/480] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:44 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:45.183384 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-670c8d85-e698-4a7c-9fd2-be87b8733cc8 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:45.192514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-670c8d85-e698-4a7c-9fd2-be87b8733cc8 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.227158 May 13 13:28:45.193097 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 251/481] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:44 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:45.650437 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1d162bc4-13dd-496f-aeab-686690b47911 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8105072d-3542-45d8-a219-b8b413d7e40a"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:45.651829 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1d162bc4-13dd-496f-aeab-686690b47911 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:45.659067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1d162bc4-13dd-496f-aeab-686690b47911 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:45.664474 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1d162bc4-13dd-496f-aeab-686690b47911 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:45.664474 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1d162bc4-13dd-496f-aeab-686690b47911 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:45.664474 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1d162bc4-13dd-496f-aeab-686690b47911 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:46.114896 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7701d67b-7c56-4c07-afd2-e663b7e89f78 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:46.116241 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7701d67b-7c56-4c07-afd2-e663b7e89f78 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:46.122722 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7701d67b-7c56-4c07-afd2-e663b7e89f78 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:46.123858 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7701d67b-7c56-4c07-afd2-e663b7e89f78 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:46.125501 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7701d67b-7c56-4c07-afd2-e663b7e89f78 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:46.126684 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7701d67b-7c56-4c07-afd2-e663b7e89f78 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:46.349641 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7701d67b-7c56-4c07-afd2-e663b7e89f78 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:46.360847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7701d67b-7c56-4c07-afd2-e663b7e89f78 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.249647 May 13 13:28:46.370302 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 252/482] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:46 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:46.375531 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-83421b31-2500-4198-b782-300edfc6ffaa tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:46.376141 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-83421b31-2500-4198-b782-300edfc6ffaa tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:46.382833 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-83421b31-2500-4198-b782-300edfc6ffaa tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:46.383296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-83421b31-2500-4198-b782-300edfc6ffaa tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:46.399768 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-83421b31-2500-4198-b782-300edfc6ffaa tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:46.400501 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-83421b31-2500-4198-b782-300edfc6ffaa tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:46.625503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-83421b31-2500-4198-b782-300edfc6ffaa tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:46.643111 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-83421b31-2500-4198-b782-300edfc6ffaa tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.279361 May 13 13:28:46.659697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 253/483] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:46 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:47.378439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f0434a58-f93f-4ade-8178-8ef26cd60161 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:47.379906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f0434a58-f93f-4ade-8178-8ef26cd60161 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:47.387067 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f0434a58-f93f-4ade-8178-8ef26cd60161 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:47.387924 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f0434a58-f93f-4ade-8178-8ef26cd60161 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:47.390223 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f0434a58-f93f-4ade-8178-8ef26cd60161 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:47.390967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f0434a58-f93f-4ade-8178-8ef26cd60161 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:47.800913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f0434a58-f93f-4ade-8178-8ef26cd60161 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:47.809211 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f0434a58-f93f-4ade-8178-8ef26cd60161 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.434965 May 13 13:28:47.810439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 254/484] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:47 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:47.822686 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a9b4e39b-3631-4a72-83f3-c7441537318a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:47.823316 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a9b4e39b-3631-4a72-83f3-c7441537318a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:47.832698 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a9b4e39b-3631-4a72-83f3-c7441537318a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:47.835099 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a9b4e39b-3631-4a72-83f3-c7441537318a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:47.836177 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a9b4e39b-3631-4a72-83f3-c7441537318a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:47.836635 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a9b4e39b-3631-4a72-83f3-c7441537318a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:47.993226 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a9b4e39b-3631-4a72-83f3-c7441537318a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:47.996816 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a9b4e39b-3631-4a72-83f3-c7441537318a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.183878 May 13 13:28:47.997511 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 255/485] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:47 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:48.828323 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-91d29f5f-26fc-4aac-80fe-2c6a0aac56dd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:48.829598 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-91d29f5f-26fc-4aac-80fe-2c6a0aac56dd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:48.837128 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-91d29f5f-26fc-4aac-80fe-2c6a0aac56dd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:48.837259 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-91d29f5f-26fc-4aac-80fe-2c6a0aac56dd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:48.839078 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-91d29f5f-26fc-4aac-80fe-2c6a0aac56dd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:48.841393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-91d29f5f-26fc-4aac-80fe-2c6a0aac56dd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:49.005137 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-91d29f5f-26fc-4aac-80fe-2c6a0aac56dd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:49.019843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-91d29f5f-26fc-4aac-80fe-2c6a0aac56dd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.193248 May 13 13:28:49.019843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 256/486] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:48 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:49.023043 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2ff90cd7-b3fc-4427-a6af-b07d5e362a7f tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:49.023828 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2ff90cd7-b3fc-4427-a6af-b07d5e362a7f tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:49.030409 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2ff90cd7-b3fc-4427-a6af-b07d5e362a7f tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:49.031109 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2ff90cd7-b3fc-4427-a6af-b07d5e362a7f tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:49.032675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2ff90cd7-b3fc-4427-a6af-b07d5e362a7f tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:49.033343 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2ff90cd7-b3fc-4427-a6af-b07d5e362a7f tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:49.238584 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1d162bc4-13dd-496f-aeab-686690b47911 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "POST /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.591717 May 13 13:28:49.240137 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 231/487] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:28:45 2022] POST /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments => generated 194 bytes in 3595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:49.288960 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2ff90cd7-b3fc-4427-a6af-b07d5e362a7f tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:49.297386 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2ff90cd7-b3fc-4427-a6af-b07d5e362a7f tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.278341 May 13 13:28:49.298202 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 257/488] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:49 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:49.572921 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-e3b25ffa-fee3-4d76-8488-bfff32c814eb req-f9af1b0e-491e-48d6-9185-60a5c4a49e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92bf6a17-fa9f-410e-b25d-4053de456900", "tag": "77185538-d455-4ce8-942b-c0fc75b37ded"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:49.584707 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-e3b25ffa-fee3-4d76-8488-bfff32c814eb req-f9af1b0e-491e-48d6-9185-60a5c4a49e93 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:49.585256 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-e3b25ffa-fee3-4d76-8488-bfff32c814eb req-f9af1b0e-491e-48d6-9185-60a5c4a49e93 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:49.598452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-e3b25ffa-fee3-4d76-8488-bfff32c814eb req-f9af1b0e-491e-48d6-9185-60a5c4a49e93 service nova] Creating event network-changed:77185538-d455-4ce8-942b-c0fc75b37ded for instance 92bf6a17-fa9f-410e-b25d-4053de456900 on hv-cinder-84159 May 13 13:28:49.603550 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-e3b25ffa-fee3-4d76-8488-bfff32c814eb req-f9af1b0e-491e-48d6-9185-60a5c4a49e93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037754 May 13 13:28:49.605668 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 232/489] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:50.035170 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-555b2591-529e-4ee3-8003-5dd494931ccc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:50.035790 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-555b2591-529e-4ee3-8003-5dd494931ccc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:50.043297 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-555b2591-529e-4ee3-8003-5dd494931ccc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:50.043754 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-555b2591-529e-4ee3-8003-5dd494931ccc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:50.045906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-555b2591-529e-4ee3-8003-5dd494931ccc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:50.046363 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-555b2591-529e-4ee3-8003-5dd494931ccc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:50.192188 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-555b2591-529e-4ee3-8003-5dd494931ccc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:50.199461 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-555b2591-529e-4ee3-8003-5dd494931ccc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.168064 May 13 13:28:50.200044 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 258/490] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:50 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:50.314696 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f021f4dc-0642-479a-9393-2f016b4c78f5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:50.316055 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f021f4dc-0642-479a-9393-2f016b4c78f5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:50.323761 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f021f4dc-0642-479a-9393-2f016b4c78f5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:50.324764 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f021f4dc-0642-479a-9393-2f016b4c78f5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:50.325747 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f021f4dc-0642-479a-9393-2f016b4c78f5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:50.327299 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f021f4dc-0642-479a-9393-2f016b4c78f5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:50.537411 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f021f4dc-0642-479a-9393-2f016b4c78f5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:50.546028 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f021f4dc-0642-479a-9393-2f016b4c78f5 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.236087 May 13 13:28:50.546922 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 233/491] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:50 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:50.830933 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-813bd502-e900-4658-88ad-f7261389e5d9 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:50.831537 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-813bd502-e900-4658-88ad-f7261389e5d9 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:50.838919 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-813bd502-e900-4658-88ad-f7261389e5d9 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:50.839377 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-813bd502-e900-4658-88ad-f7261389e5d9 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:50.840168 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-813bd502-e900-4658-88ad-f7261389e5d9 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:50.840688 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-813bd502-e900-4658-88ad-f7261389e5d9 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:50.876048 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-813bd502-e900-4658-88ad-f7261389e5d9 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:28:51.217113 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-942f9d70-bedf-47b0-8d27-56f1b7de685b tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:51.221558 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-942f9d70-bedf-47b0-8d27-56f1b7de685b tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:51.224663 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-942f9d70-bedf-47b0-8d27-56f1b7de685b tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:51.225126 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-942f9d70-bedf-47b0-8d27-56f1b7de685b tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:51.225938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-942f9d70-bedf-47b0-8d27-56f1b7de685b tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:51.226397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-942f9d70-bedf-47b0-8d27-56f1b7de685b tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:51.310359 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-813bd502-e900-4658-88ad-f7261389e5d9 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "DELETE /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 204 len: 0 microversion: 2.1 time: 0.485482 May 13 13:28:51.313472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 259/492] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:28:50 2022] DELETE /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:28:51.329829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-de166d75-b83c-4eec-b080-3359ef29b993 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:51.330956 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-de166d75-b83c-4eec-b080-3359ef29b993 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:51.339520 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-de166d75-b83c-4eec-b080-3359ef29b993 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:51.340282 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-de166d75-b83c-4eec-b080-3359ef29b993 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:51.341355 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-de166d75-b83c-4eec-b080-3359ef29b993 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:51.343165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-de166d75-b83c-4eec-b080-3359ef29b993 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:51.381426 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-942f9d70-bedf-47b0-8d27-56f1b7de685b tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:51.390476 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-942f9d70-bedf-47b0-8d27-56f1b7de685b tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.177269 May 13 13:28:51.393728 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 234/493] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:51 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:51.563333 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c4a9826b-eb8a-4b18-ad76-ac89f37d5129 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:51.564006 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c4a9826b-eb8a-4b18-ad76-ac89f37d5129 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:51.570302 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c4a9826b-eb8a-4b18-ad76-ac89f37d5129 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:51.570983 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c4a9826b-eb8a-4b18-ad76-ac89f37d5129 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:51.572003 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c4a9826b-eb8a-4b18-ad76-ac89f37d5129 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:51.572589 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c4a9826b-eb8a-4b18-ad76-ac89f37d5129 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:51.585888 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-de166d75-b83c-4eec-b080-3359ef29b993 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:51.598576 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-de166d75-b83c-4eec-b080-3359ef29b993 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1514 microversion: 2.1 time: 0.274789 May 13 13:28:51.599414 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 260/494] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:51 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:51.750297 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c4a9826b-eb8a-4b18-ad76-ac89f37d5129 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:51.759169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c4a9826b-eb8a-4b18-ad76-ac89f37d5129 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1314 microversion: 2.1 time: 0.199971 May 13 13:28:51.760323 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 235/495] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:51 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:52.408359 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-75b81038-78ee-4932-aa71-a031ee9568a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:52.409088 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-75b81038-78ee-4932-aa71-a031ee9568a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:52.416172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75b81038-78ee-4932-aa71-a031ee9568a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:52.416905 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75b81038-78ee-4932-aa71-a031ee9568a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:52.419545 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75b81038-78ee-4932-aa71-a031ee9568a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:52.420673 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75b81038-78ee-4932-aa71-a031ee9568a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:52.622837 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-eec59ed7-85b1-4c84-980d-4d0cf093de03 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:52.624669 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-eec59ed7-85b1-4c84-980d-4d0cf093de03 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:52.633674 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eec59ed7-85b1-4c84-980d-4d0cf093de03 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:52.634909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eec59ed7-85b1-4c84-980d-4d0cf093de03 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:52.636142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eec59ed7-85b1-4c84-980d-4d0cf093de03 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:52.636583 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eec59ed7-85b1-4c84-980d-4d0cf093de03 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:52.655402 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-75b81038-78ee-4932-aa71-a031ee9568a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:52.676589 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-75b81038-78ee-4932-aa71-a031ee9568a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.272825 May 13 13:28:52.687837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 261/496] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:52 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:52.780053 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5f32e2de-feb5-4d28-bed8-7470f95f2dad tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:52.780693 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5f32e2de-feb5-4d28-bed8-7470f95f2dad tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:52.788743 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5f32e2de-feb5-4d28-bed8-7470f95f2dad tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:52.789203 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5f32e2de-feb5-4d28-bed8-7470f95f2dad tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:52.790345 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5f32e2de-feb5-4d28-bed8-7470f95f2dad tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:52.791228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5f32e2de-feb5-4d28-bed8-7470f95f2dad tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:52.798353 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-eec59ed7-85b1-4c84-980d-4d0cf093de03 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:52.806218 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-eec59ed7-85b1-4c84-980d-4d0cf093de03 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1514 microversion: 2.1 time: 0.187767 May 13 13:28:52.810391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 236/497] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:52 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:52.863982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-355a8b11-e668-4dfa-a2af-fbcebcf55977 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:52.865480 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-355a8b11-e668-4dfa-a2af-fbcebcf55977 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:52.870581 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-355a8b11-e668-4dfa-a2af-fbcebcf55977 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:52.871040 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-355a8b11-e668-4dfa-a2af-fbcebcf55977 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:52.872289 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-355a8b11-e668-4dfa-a2af-fbcebcf55977 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:52.872763 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-355a8b11-e668-4dfa-a2af-fbcebcf55977 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:52.948528 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5f32e2de-feb5-4d28-bed8-7470f95f2dad tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:52.957388 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5f32e2de-feb5-4d28-bed8-7470f95f2dad tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1464 microversion: 2.1 time: 0.184746 May 13 13:28:52.957989 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 262/498] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:52 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1464 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:52.964416 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-355a8b11-e668-4dfa-a2af-fbcebcf55977 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lazy-loading 'services' on Instance uuid 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:28:53.128996 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f707ac75-476b-4597-8fb7-cc61f983a5b2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Action: 'create', calling method: .version_select at 0x7faaa2083b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1357767532", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVIsL3ErWOW/V7G2kDE9HspTDoYQParxwyw6nHXSb106penCN1KAOR4YhRrwIg+Xoo/k7zvVT9K0wy2+wpDpA/LYfCiOntd5M2ueQrDN6XxeLjQP9rbz8K556CT1VbBpw=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:53.155267 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-f707ac75-476b-4597-8fb7-cc61f983a5b2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Getting quotas for project d3e32e04d1f44e97b903f98c7c2749db. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:28:53.155267 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-f707ac75-476b-4597-8fb7-cc61f983a5b2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Getting quotas for user 8101850dd18f4108ac12ff9487cbbe3e and project d3e32e04d1f44e97b903f98c7c2749db. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:28:53.262193 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f707ac75-476b-4597-8fb7-cc61f983a5b2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.302902 May 13 13:28:53.262793 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 263/499] 10.222.0.25 () {60 vars in 1158 bytes} [Fri May 13 13:28:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:53.278267 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-239b1912-9b93-4153-b0b6-02ba3657a90d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:53.278781 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-239b1912-9b93-4153-b0b6-02ba3657a90d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:53.280580 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-355a8b11-e668-4dfa-a2af-fbcebcf55977 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/os-volume_attachments/59198fe1-c6dd-4af9-a2b0-277418cb79a4" status: 202 len: 0 microversion: 2.1 time: 0.418093 May 13 13:28:53.284616 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 237/500] 10.222.0.25 () {58 vars in 1415 bytes} [Fri May 13 13:28:52 2022] DELETE /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/os-volume_attachments/59198fe1-c6dd-4af9-a2b0-277418cb79a4 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:28:53.287583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-239b1912-9b93-4153-b0b6-02ba3657a90d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:53.288108 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-239b1912-9b93-4153-b0b6-02ba3657a90d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:53.288871 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-239b1912-9b93-4153-b0b6-02ba3657a90d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:53.289318 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-239b1912-9b93-4153-b0b6-02ba3657a90d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:53.323157 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-239b1912-9b93-4153-b0b6-02ba3657a90d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:28:53.694572 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-44f84b3e-d544-48f2-bcad-f0bbe702b357 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:53.695282 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-44f84b3e-d544-48f2-bcad-f0bbe702b357 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:53.701527 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-44f84b3e-d544-48f2-bcad-f0bbe702b357 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:53.702780 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-44f84b3e-d544-48f2-bcad-f0bbe702b357 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:53.703564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-44f84b3e-d544-48f2-bcad-f0bbe702b357 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:53.704070 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-44f84b3e-d544-48f2-bcad-f0bbe702b357 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:53.813537 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-239b1912-9b93-4153-b0b6-02ba3657a90d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 204 len: 0 microversion: 2.1 time: 0.549420 May 13 13:28:53.814268 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 264/501] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:28:53 2022] DELETE /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:28:53.822472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8a0f4243-d05f-459c-b688-24b9c6ec7074 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:53.824562 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8a0f4243-d05f-459c-b688-24b9c6ec7074 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:53.829877 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a0f4243-d05f-459c-b688-24b9c6ec7074 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:53.830333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a0f4243-d05f-459c-b688-24b9c6ec7074 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:53.831102 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a0f4243-d05f-459c-b688-24b9c6ec7074 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:53.831727 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8a0f4243-d05f-459c-b688-24b9c6ec7074 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:53.838572 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-44f84b3e-d544-48f2-bcad-f0bbe702b357 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:53.846092 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-44f84b3e-d544-48f2-bcad-f0bbe702b357 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.156093 May 13 13:28:53.846753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 238/502] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:53 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:53.851245 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d83c248a-c6ed-4158-8b02-2328d720baf7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:53.851929 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d83c248a-c6ed-4158-8b02-2328d720baf7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:53.858423 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d83c248a-c6ed-4158-8b02-2328d720baf7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:53.858964 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d83c248a-c6ed-4158-8b02-2328d720baf7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:53.859839 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d83c248a-c6ed-4158-8b02-2328d720baf7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:53.860360 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d83c248a-c6ed-4158-8b02-2328d720baf7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:54.003353 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d83c248a-c6ed-4158-8b02-2328d720baf7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:54.011838 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d83c248a-c6ed-4158-8b02-2328d720baf7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1514 microversion: 2.1 time: 0.164026 May 13 13:28:54.012842 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 239/503] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:53 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:54.320594 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8a0f4243-d05f-459c-b688-24b9c6ec7074 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:54.328464 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8a0f4243-d05f-459c-b688-24b9c6ec7074 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1470 microversion: 2.1 time: 0.509982 May 13 13:28:54.330727 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 265/504] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:53 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1470 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:54.862931 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-066127b8-ab50-4c90-899d-b23fb3484f8e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:54.864142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-066127b8-ab50-4c90-899d-b23fb3484f8e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:54.870788 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-066127b8-ab50-4c90-899d-b23fb3484f8e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:54.871247 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-066127b8-ab50-4c90-899d-b23fb3484f8e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:54.872354 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-066127b8-ab50-4c90-899d-b23fb3484f8e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:54.872821 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-066127b8-ab50-4c90-899d-b23fb3484f8e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:55.008084 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-066127b8-ab50-4c90-899d-b23fb3484f8e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:55.016572 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-066127b8-ab50-4c90-899d-b23fb3484f8e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.157701 May 13 13:28:55.017130 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 240/505] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:54 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:55.028388 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-aae91576-deff-468d-baf9-b639ae95347b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:55.029022 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-aae91576-deff-468d-baf9-b639ae95347b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:55.034923 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aae91576-deff-468d-baf9-b639ae95347b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:55.035455 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aae91576-deff-468d-baf9-b639ae95347b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:55.036259 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aae91576-deff-468d-baf9-b639ae95347b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:55.036697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-aae91576-deff-468d-baf9-b639ae95347b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:55.184298 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-aae91576-deff-468d-baf9-b639ae95347b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:55.192868 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-aae91576-deff-468d-baf9-b639ae95347b tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1514 microversion: 2.1 time: 0.168244 May 13 13:28:55.197506 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 266/506] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:55 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:55.345371 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a7bd14da-3eb1-4732-aa72-94874fde106a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:55.346022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a7bd14da-3eb1-4732-aa72-94874fde106a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:55.352093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a7bd14da-3eb1-4732-aa72-94874fde106a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:55.352576 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a7bd14da-3eb1-4732-aa72-94874fde106a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:55.353358 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a7bd14da-3eb1-4732-aa72-94874fde106a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:55.353855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a7bd14da-3eb1-4732-aa72-94874fde106a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:55.535703 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a7bd14da-3eb1-4732-aa72-94874fde106a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:55.548060 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a7bd14da-3eb1-4732-aa72-94874fde106a tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1470 microversion: 2.1 time: 0.206539 May 13 13:28:55.557917 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 241/507] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:55 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1470 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:56.033277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e89bcfc5-9355-41ed-8b13-7fed409efa01 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:56.034211 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e89bcfc5-9355-41ed-8b13-7fed409efa01 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:56.040817 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e89bcfc5-9355-41ed-8b13-7fed409efa01 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:56.041578 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e89bcfc5-9355-41ed-8b13-7fed409efa01 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:56.042641 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e89bcfc5-9355-41ed-8b13-7fed409efa01 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:56.043182 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e89bcfc5-9355-41ed-8b13-7fed409efa01 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:56.187514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e89bcfc5-9355-41ed-8b13-7fed409efa01 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:56.195947 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e89bcfc5-9355-41ed-8b13-7fed409efa01 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.167126 May 13 13:28:56.196732 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 267/508] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:56 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:56.211406 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-eaa9de7a-320f-4fb4-b86b-97906efab030 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:56.212098 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-eaa9de7a-320f-4fb4-b86b-97906efab030 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:56.222466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eaa9de7a-320f-4fb4-b86b-97906efab030 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:56.223311 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eaa9de7a-320f-4fb4-b86b-97906efab030 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:56.224253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eaa9de7a-320f-4fb4-b86b-97906efab030 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:56.224693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eaa9de7a-320f-4fb4-b86b-97906efab030 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:56.393437 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-eaa9de7a-320f-4fb4-b86b-97906efab030 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:56.424821 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-eaa9de7a-320f-4fb4-b86b-97906efab030 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1514 microversion: 2.1 time: 0.216440 May 13 13:28:56.432220 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 242/509] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:56 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:56.565028 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4a12681d-5c37-49a3-bfa0-b4d2030ac14d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:56.565668 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4a12681d-5c37-49a3-bfa0-b4d2030ac14d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:56.574771 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a12681d-5c37-49a3-bfa0-b4d2030ac14d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:56.576197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a12681d-5c37-49a3-bfa0-b4d2030ac14d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:56.578366 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a12681d-5c37-49a3-bfa0-b4d2030ac14d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:56.579026 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a12681d-5c37-49a3-bfa0-b4d2030ac14d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:56.881379 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4a12681d-5c37-49a3-bfa0-b4d2030ac14d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:56.890164 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4a12681d-5c37-49a3-bfa0-b4d2030ac14d tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1470 microversion: 2.1 time: 0.329529 May 13 13:28:56.905072 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 268/510] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:56 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1470 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:57.203216 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-301a50b2-dadb-4b26-88d2-e30dbb636a87 req-fe58a1aa-0aba-4bbb-b086-835815ed8aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48e0eae6-6c5f-446e-a5c3-bfccf382c353", "name": "network-vif-deleted", "tag": "517c54c5-bfa9-4ac4-b0ba-9b4f1df9e8ad"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:57.213812 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b3806c01-9ba7-4881-a063-9f09feec9315 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:57.214484 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b3806c01-9ba7-4881-a063-9f09feec9315 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:57.223472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3806c01-9ba7-4881-a063-9f09feec9315 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:57.223920 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3806c01-9ba7-4881-a063-9f09feec9315 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:57.224697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3806c01-9ba7-4881-a063-9f09feec9315 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:57.225127 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3806c01-9ba7-4881-a063-9f09feec9315 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:57.228072 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-301a50b2-dadb-4b26-88d2-e30dbb636a87 req-fe58a1aa-0aba-4bbb-b086-835815ed8aa0 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:57.228622 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-301a50b2-dadb-4b26-88d2-e30dbb636a87 req-fe58a1aa-0aba-4bbb-b086-835815ed8aa0 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:57.265138 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-301a50b2-dadb-4b26-88d2-e30dbb636a87 req-fe58a1aa-0aba-4bbb-b086-835815ed8aa0 service nova] Creating event network-vif-deleted:517c54c5-bfa9-4ac4-b0ba-9b4f1df9e8ad for instance 48e0eae6-6c5f-446e-a5c3-bfccf382c353 on hv-cinder-84159 May 13 13:28:57.270726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-301a50b2-dadb-4b26-88d2-e30dbb636a87 req-fe58a1aa-0aba-4bbb-b086-835815ed8aa0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072818 May 13 13:28:57.272654 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 243/511] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:28:57.345229 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-abec0db5-8fca-4814-9795-04b6f1adedfa req-ca42af9a-a733-4fd0-8204-19e792459302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5917161-6578-4060-bd1e-2d9a71038c11", "name": "network-vif-deleted", "tag": "e84251c9-c1ff-42fe-90fb-e8740154bb18"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:28:57.363649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-abec0db5-8fca-4814-9795-04b6f1adedfa req-ca42af9a-a733-4fd0-8204-19e792459302 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:57.368713 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-abec0db5-8fca-4814-9795-04b6f1adedfa req-ca42af9a-a733-4fd0-8204-19e792459302 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:57.379958 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-abec0db5-8fca-4814-9795-04b6f1adedfa req-ca42af9a-a733-4fd0-8204-19e792459302 service nova] Creating event network-vif-deleted:e84251c9-c1ff-42fe-90fb-e8740154bb18 for instance e5917161-6578-4060-bd1e-2d9a71038c11 on hv-cinder-84159 May 13 13:28:57.385237 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-abec0db5-8fca-4814-9795-04b6f1adedfa req-ca42af9a-a733-4fd0-8204-19e792459302 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045163 May 13 13:28:57.390828 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 244/512] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:28:57.444276 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-82ad820e-a36f-48fe-a51d-7060ec040785 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:57.445099 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-82ad820e-a36f-48fe-a51d-7060ec040785 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:57.452356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-82ad820e-a36f-48fe-a51d-7060ec040785 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:57.453055 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-82ad820e-a36f-48fe-a51d-7060ec040785 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:57.460244 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-82ad820e-a36f-48fe-a51d-7060ec040785 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:57.460244 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-82ad820e-a36f-48fe-a51d-7060ec040785 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:57.460592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b3806c01-9ba7-4881-a063-9f09feec9315 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:57.467294 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b3806c01-9ba7-4881-a063-9f09feec9315 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.256601 May 13 13:28:57.476263 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 269/513] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:57 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:57.543528 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-82ad820e-a36f-48fe-a51d-7060ec040785 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:57.553826 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-82ad820e-a36f-48fe-a51d-7060ec040785 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1304 microversion: 2.1 time: 0.114367 May 13 13:28:57.558512 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 245/514] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:57 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:57.910834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-df801b2a-5853-4745-8ea8-7227f10b1995 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:57.911442 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-df801b2a-5853-4745-8ea8-7227f10b1995 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:57.917563 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-df801b2a-5853-4745-8ea8-7227f10b1995 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:57.918056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-df801b2a-5853-4745-8ea8-7227f10b1995 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:57.918927 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-df801b2a-5853-4745-8ea8-7227f10b1995 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:57.919371 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-df801b2a-5853-4745-8ea8-7227f10b1995 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:57.950380 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-df801b2a-5853-4745-8ea8-7227f10b1995 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:57.950843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-df801b2a-5853-4745-8ea8-7227f10b1995 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:57.951290 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-df801b2a-5853-4745-8ea8-7227f10b1995 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lazy-loading 'fault' on Instance uuid e5917161-6578-4060-bd1e-2d9a71038c11 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:28:57.992682 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-df801b2a-5853-4745-8ea8-7227f10b1995 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68ac38391eab4eb99a6db0c2fd0b6b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf41675800ef4cea9d8865f15ea46d2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:58.000708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-df801b2a-5853-4745-8ea8-7227f10b1995 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 200 len: 1304 microversion: 2.1 time: 0.093803 May 13 13:28:58.001208 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 270/515] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:57 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:58.483731 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-209da446-5f5a-4031-a29f-ea06749b5d3a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:58.484351 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-209da446-5f5a-4031-a29f-ea06749b5d3a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:58.495448 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-209da446-5f5a-4031-a29f-ea06749b5d3a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.496093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-209da446-5f5a-4031-a29f-ea06749b5d3a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.497076 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-209da446-5f5a-4031-a29f-ea06749b5d3a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.497700 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-209da446-5f5a-4031-a29f-ea06749b5d3a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.571805 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-071f5fde-4fac-47cb-9d6d-e7a7678e067f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:58.572426 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-071f5fde-4fac-47cb-9d6d-e7a7678e067f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:58.589374 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-071f5fde-4fac-47cb-9d6d-e7a7678e067f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.589856 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-071f5fde-4fac-47cb-9d6d-e7a7678e067f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.590651 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-071f5fde-4fac-47cb-9d6d-e7a7678e067f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.591096 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-071f5fde-4fac-47cb-9d6d-e7a7678e067f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.634392 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-071f5fde-4fac-47cb-9d6d-e7a7678e067f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:58.635046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-071f5fde-4fac-47cb-9d6d-e7a7678e067f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:58.635812 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-071f5fde-4fac-47cb-9d6d-e7a7678e067f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lazy-loading 'fault' on Instance uuid 48e0eae6-6c5f-446e-a5c3-bfccf382c353 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:28:58.685472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-071f5fde-4fac-47cb-9d6d-e7a7678e067f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:58.693521 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-071f5fde-4fac-47cb-9d6d-e7a7678e067f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 200 len: 1309 microversion: 2.1 time: 0.125595 May 13 13:28:58.694989 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 271/516] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:58 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 1309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:28:58.738909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-209da446-5f5a-4031-a29f-ea06749b5d3a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:58.747838 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-209da446-5f5a-4031-a29f-ea06749b5d3a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.266530 May 13 13:28:58.747838 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 246/517] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:58 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:28:59.018506 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c65974a8-f7a2-4606-b08e-c4a32ba85b30 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:59.019194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c65974a8-f7a2-4606-b08e-c4a32ba85b30 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] [instance: e5917161-6578-4060-bd1e-2d9a71038c11] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:59.025460 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c65974a8-f7a2-4606-b08e-c4a32ba85b30 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:59.026222 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c65974a8-f7a2-4606-b08e-c4a32ba85b30 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:59.027276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c65974a8-f7a2-4606-b08e-c4a32ba85b30 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:59.028974 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c65974a8-f7a2-4606-b08e-c4a32ba85b30 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:59.043564 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-c65974a8-f7a2-4606-b08e-c4a32ba85b30 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] HTTP exception thrown: Instance e5917161-6578-4060-bd1e-2d9a71038c11 could not be found. May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c65974a8-f7a2-4606-b08e-c4a32ba85b30 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Request method failure captured: May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 HTTP/1.1 May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflzs9yoRM5PpPfxyWuNefE07dF4ruF7_VC4yLFt8HjDusnoVbnrvyDLman-LTHNVg_9LBQO7P73siTEj0cFfq-I5rxsle_zxRNtCzJoJW_QA70OiN5t1m9rwLiLsrhzxG3UxlSx7iQKKHZyZepGWGIqTur9-6pya5Ip-eP4B-s_safE May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: cf41675800ef4cea9d8865f15ea46d2e May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesNegativeTest-902091905 May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:28:59.045276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:28:59.047101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf41675800ef4cea9d8865f15ea46d2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_cf41675800ef4cea9d8865f15ea46d2e", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/cf41675800ef4cea9d8865f15ea46d2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/cf41675800ef4cea9d8865f15ea46d2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:28:59.047101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesNegativeTest-902091905 May 13 13:28:59.047101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: cf41675800ef4cea9d8865f15ea46d2e May 13 13:28:59.047101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesNegativeTest-902091905 May 13 13:28:59.047101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesNegativeTest-902091905-project May 13 13:28:59.047101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:28:59.047101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:28:59.047101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 68ac38391eab4eb99a6db0c2fd0b6b1f May 13 13:28:59.047101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesNegativeTest-902091905-project May 13 13:28:59.047101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:28:59.047101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance e5917161-6578-4060-bd1e-2d9a71038c11 could not be found. May 13 13:28:59.047101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'e5917161-6578-4060-bd1e-2d9a71038c11'} May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5917161-6578-4060-bd1e-2d9a71038c11 could not be found. May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:28:59.048063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5917161-6578-4060-bd1e-2d9a71038c11 could not be found. May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5917161-6578-4060-bd1e-2d9a71038c11 could not be found. May 13 13:28:59.049710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:28:59.050867 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c65974a8-f7a2-4606-b08e-c4a32ba85b30 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] Returning 404 to user: Instance e5917161-6578-4060-bd1e-2d9a71038c11 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:28:59.050867 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c65974a8-f7a2-4606-b08e-c4a32ba85b30 tempest-VolumesNegativeTest-902091905 tempest-VolumesNegativeTest-902091905-project] 10.222.0.25 "GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11" status: 404 len: 111 microversion: 2.1 time: 0.032792 May 13 13:28:59.051126 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 272/518] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:59 2022] GET /compute/v2.1/servers/e5917161-6578-4060-bd1e-2d9a71038c11 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:28:59.712531 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-52bb125b-dc60-4c6a-ae50-1e935aaabbce tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:59.713144 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-52bb125b-dc60-4c6a-ae50-1e935aaabbce tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 48e0eae6-6c5f-446e-a5c3-bfccf382c353] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:59.720208 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-52bb125b-dc60-4c6a-ae50-1e935aaabbce tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:59.720658 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-52bb125b-dc60-4c6a-ae50-1e935aaabbce tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:59.721429 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-52bb125b-dc60-4c6a-ae50-1e935aaabbce tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:59.721888 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-52bb125b-dc60-4c6a-ae50-1e935aaabbce tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:59.738033 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-52bb125b-dc60-4c6a-ae50-1e935aaabbce tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] HTTP exception thrown: Instance 48e0eae6-6c5f-446e-a5c3-bfccf382c353 could not be found. May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-52bb125b-dc60-4c6a-ae50-1e935aaabbce tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Request method failure captured: May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 HTTP/1.1 May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflyp0KXFRH6syBLY2FsKk4upwAdN8wFjS3K3uQrmN43aaHkQOdGy5-R6FRyblAGAschpmHbDkFkC3PEN4WgYNOcJoB_voKXv-kTskEQ3gKcea_F-9tbyKYJmP8YISH3ASSVr5wYTG6PhPWk630UBaQNM-PT7JrAYSXW1-6YBVD1Etek May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: b361133457c04e2da4c4158a45bbcf19 May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1914169004 May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:28:59.739950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:28:59.741389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b361133457c04e2da4c4158a45bbcf19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b361133457c04e2da4c4158a45bbcf19", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b361133457c04e2da4c4158a45bbcf19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b361133457c04e2da4c4158a45bbcf19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:28:59.741389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-VolumesSnapshotTestJSON-1914169004 May 13 13:28:59.741389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: b361133457c04e2da4c4158a45bbcf19 May 13 13:28:59.741389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1914169004 May 13 13:28:59.741389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-VolumesSnapshotTestJSON-1914169004-project May 13 13:28:59.741389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:28:59.741389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:28:59.741389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 15932bb7b3044a41942b4e0edecebf10 May 13 13:28:59.741389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-VolumesSnapshotTestJSON-1914169004-project May 13 13:28:59.741389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:28:59.741389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 48e0eae6-6c5f-446e-a5c3-bfccf382c353 could not be found. May 13 13:28:59.741389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '48e0eae6-6c5f-446e-a5c3-bfccf382c353'} May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48e0eae6-6c5f-446e-a5c3-bfccf382c353 could not be found. May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:28:59.742230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48e0eae6-6c5f-446e-a5c3-bfccf382c353 could not be found. May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48e0eae6-6c5f-446e-a5c3-bfccf382c353 could not be found. May 13 13:28:59.743569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:28:59.745618 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-52bb125b-dc60-4c6a-ae50-1e935aaabbce tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Returning 404 to user: Instance 48e0eae6-6c5f-446e-a5c3-bfccf382c353 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:28:59.746664 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-52bb125b-dc60-4c6a-ae50-1e935aaabbce tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353" status: 404 len: 111 microversion: 2.1 time: 0.038173 May 13 13:28:59.747221 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 247/519] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:59 2022] GET /compute/v2.1/servers/48e0eae6-6c5f-446e-a5c3-bfccf382c353 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:28:59.765545 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1606c9ee-bb43-4d09-9a71-7a2c7d8ee8ac tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:28:59.768267 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1606c9ee-bb43-4d09-9a71-7a2c7d8ee8ac tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:28:59.777178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1606c9ee-bb43-4d09-9a71-7a2c7d8ee8ac tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:59.777732 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1606c9ee-bb43-4d09-9a71-7a2c7d8ee8ac tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:59.778613 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1606c9ee-bb43-4d09-9a71-7a2c7d8ee8ac tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:28:59.779061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1606c9ee-bb43-4d09-9a71-7a2c7d8ee8ac tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:28:59.927663 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1606c9ee-bb43-4d09-9a71-7a2c7d8ee8ac tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:28:59.935049 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1606c9ee-bb43-4d09-9a71-7a2c7d8ee8ac tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.174545 May 13 13:28:59.935662 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 273/520] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:28:59 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:00.605036 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-0fa8e800-bc1a-48ac-a1f2-08e11146f7f1 req-a4c3fa5b-bb17-4165-ae8f-0c27a9dafb33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92bf6a17-fa9f-410e-b25d-4053de456900", "name": "network-vif-plugged", "status": "completed", "tag": "77185538-d455-4ce8-942b-c0fc75b37ded"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:00.614742 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-0fa8e800-bc1a-48ac-a1f2-08e11146f7f1 req-a4c3fa5b-bb17-4165-ae8f-0c27a9dafb33 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:00.615195 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-0fa8e800-bc1a-48ac-a1f2-08e11146f7f1 req-a4c3fa5b-bb17-4165-ae8f-0c27a9dafb33 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:00.627281 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-0fa8e800-bc1a-48ac-a1f2-08e11146f7f1 req-a4c3fa5b-bb17-4165-ae8f-0c27a9dafb33 service nova] Creating event network-vif-plugged:77185538-d455-4ce8-942b-c0fc75b37ded for instance 92bf6a17-fa9f-410e-b25d-4053de456900 on hv-cinder-84159 May 13 13:29:00.632264 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-0fa8e800-bc1a-48ac-a1f2-08e11146f7f1 req-a4c3fa5b-bb17-4165-ae8f-0c27a9dafb33 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031192 May 13 13:29:00.632975 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 248/521] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:00.951548 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-45dd281c-33b7-4186-82af-f77a3287794c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:00.952420 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-45dd281c-33b7-4186-82af-f77a3287794c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:00.958476 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-45dd281c-33b7-4186-82af-f77a3287794c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:00.958935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-45dd281c-33b7-4186-82af-f77a3287794c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:00.959702 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-45dd281c-33b7-4186-82af-f77a3287794c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:00.960146 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-45dd281c-33b7-4186-82af-f77a3287794c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:01.095379 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-45dd281c-33b7-4186-82af-f77a3287794c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:01.102916 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-45dd281c-33b7-4186-82af-f77a3287794c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.155189 May 13 13:29:01.103488 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 274/522] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:00 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:01.146151 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a929df48-f096-4f8b-acbd-6e95bcceff5d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:01.147219 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a929df48-f096-4f8b-acbd-6e95bcceff5d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:01.153077 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a929df48-f096-4f8b-acbd-6e95bcceff5d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:01.153525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a929df48-f096-4f8b-acbd-6e95bcceff5d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:01.154833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a929df48-f096-4f8b-acbd-6e95bcceff5d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:01.155265 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a929df48-f096-4f8b-acbd-6e95bcceff5d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:01.180459 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-a929df48-f096-4f8b-acbd-6e95bcceff5d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lazy-loading 'flavor' on Instance uuid c8063f90-dde5-4697-b772-2d63abfae0ec {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:29:01.682732 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a929df48-f096-4f8b-acbd-6e95bcceff5d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "POST /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/action" status: 200 len: 32 microversion: 2.1 time: 0.541717 May 13 13:29:01.683351 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 249/523] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:29:01 2022] POST /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/action => generated 32 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:29:01.692340 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e68c2d93-3590-4ff8-91c3-4b2658a848ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:01.692989 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e68c2d93-3590-4ff8-91c3-4b2658a848ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:01.699349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e68c2d93-3590-4ff8-91c3-4b2658a848ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:01.700852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e68c2d93-3590-4ff8-91c3-4b2658a848ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:01.700852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e68c2d93-3590-4ff8-91c3-4b2658a848ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:01.701705 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e68c2d93-3590-4ff8-91c3-4b2658a848ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:01.843849 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e68c2d93-3590-4ff8-91c3-4b2658a848ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:01.852811 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e68c2d93-3590-4ff8-91c3-4b2658a848ec tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.164247 May 13 13:29:01.853417 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 275/524] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:01 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:02.131857 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5bbfac1f-b52e-44ab-ade7-c1e816fff5b3 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:02.132750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-5bbfac1f-b52e-44ab-ade7-c1e816fff5b3 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:02.140000 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5bbfac1f-b52e-44ab-ade7-c1e816fff5b3 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:02.140461 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5bbfac1f-b52e-44ab-ade7-c1e816fff5b3 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:02.141245 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5bbfac1f-b52e-44ab-ade7-c1e816fff5b3 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:02.141684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5bbfac1f-b52e-44ab-ade7-c1e816fff5b3 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:02.280872 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-5bbfac1f-b52e-44ab-ade7-c1e816fff5b3 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:02.290185 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-5bbfac1f-b52e-44ab-ade7-c1e816fff5b3 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.162534 May 13 13:29:02.290744 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 250/525] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:02 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:02.877576 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-972f551c-1663-4e6f-be3c-889f9100e7dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:02.878233 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-972f551c-1663-4e6f-be3c-889f9100e7dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:02.884564 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-972f551c-1663-4e6f-be3c-889f9100e7dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:02.884808 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-972f551c-1663-4e6f-be3c-889f9100e7dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:02.885889 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-972f551c-1663-4e6f-be3c-889f9100e7dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:02.886490 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-972f551c-1663-4e6f-be3c-889f9100e7dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:03.039557 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-972f551c-1663-4e6f-be3c-889f9100e7dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:03.050001 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-972f551c-1663-4e6f-be3c-889f9100e7dd tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.176266 May 13 13:29:03.050584 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 276/526] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:02 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:03.307313 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-514790dc-c797-4b61-acf3-c744f2665528 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:03.307923 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-514790dc-c797-4b61-acf3-c744f2665528 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:03.314788 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-514790dc-c797-4b61-acf3-c744f2665528 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:03.315240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-514790dc-c797-4b61-acf3-c744f2665528 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:03.316011 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-514790dc-c797-4b61-acf3-c744f2665528 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:03.316449 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-514790dc-c797-4b61-acf3-c744f2665528 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:03.458481 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-514790dc-c797-4b61-acf3-c744f2665528 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:03.470953 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-514790dc-c797-4b61-acf3-c744f2665528 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.167152 May 13 13:29:03.480063 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 251/527] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:03 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:04.067027 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5fb15aed-c926-4d52-afeb-1a9588a78811 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:04.067716 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5fb15aed-c926-4d52-afeb-1a9588a78811 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:04.073602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5fb15aed-c926-4d52-afeb-1a9588a78811 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:04.074076 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5fb15aed-c926-4d52-afeb-1a9588a78811 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:04.074847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5fb15aed-c926-4d52-afeb-1a9588a78811 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:04.075285 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5fb15aed-c926-4d52-afeb-1a9588a78811 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:04.221569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8ceda9b2-9e2a-4f40-863d-8de174915fb7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:04.227758 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8ceda9b2-9e2a-4f40-863d-8de174915fb7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:04.228303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8ceda9b2-9e2a-4f40-863d-8de174915fb7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:04.250074 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5fb15aed-c926-4d52-afeb-1a9588a78811 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:04.253982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8ceda9b2-9e2a-4f40-863d-8de174915fb7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Going to try to stop instance {{(pid=117602) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 13:29:04.258322 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5fb15aed-c926-4d52-afeb-1a9588a78811 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.195131 May 13 13:29:04.267918 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 277/528] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:04 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:04.487066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e44e78f2-63f2-4e92-bde1-a1caffbd6a9a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:04.487770 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e44e78f2-63f2-4e92-bde1-a1caffbd6a9a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:04.493739 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e44e78f2-63f2-4e92-bde1-a1caffbd6a9a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:04.494350 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e44e78f2-63f2-4e92-bde1-a1caffbd6a9a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:04.495137 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e44e78f2-63f2-4e92-bde1-a1caffbd6a9a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:04.495584 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e44e78f2-63f2-4e92-bde1-a1caffbd6a9a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:04.509615 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8ceda9b2-9e2a-4f40-863d-8de174915fb7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "POST /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/action" status: 202 len: 0 microversion: 2.1 time: 0.292395 May 13 13:29:04.510410 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 252/529] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:29:04 2022] POST /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:29:04.523477 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4e1c49e9-b003-4e69-b97f-70b695ae5328 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:04.524408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-4e1c49e9-b003-4e69-b97f-70b695ae5328 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:04.532005 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4e1c49e9-b003-4e69-b97f-70b695ae5328 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:04.532483 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4e1c49e9-b003-4e69-b97f-70b695ae5328 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:04.533431 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4e1c49e9-b003-4e69-b97f-70b695ae5328 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:04.534043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4e1c49e9-b003-4e69-b97f-70b695ae5328 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:04.679880 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-4e1c49e9-b003-4e69-b97f-70b695ae5328 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:04.693839 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4e1c49e9-b003-4e69-b97f-70b695ae5328 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.174501 May 13 13:29:04.694747 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 253/530] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:04 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:04.709986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e44e78f2-63f2-4e92-bde1-a1caffbd6a9a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:04.717696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e44e78f2-63f2-4e92-bde1-a1caffbd6a9a tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1357 microversion: 2.1 time: 0.231556 May 13 13:29:04.717696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 278/531] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:04 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:05.276316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e327fef2-936e-4e31-9a3c-9a43baa1370f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:05.277078 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e327fef2-936e-4e31-9a3c-9a43baa1370f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:05.283480 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e327fef2-936e-4e31-9a3c-9a43baa1370f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:05.283941 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e327fef2-936e-4e31-9a3c-9a43baa1370f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:05.284735 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e327fef2-936e-4e31-9a3c-9a43baa1370f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:05.285176 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e327fef2-936e-4e31-9a3c-9a43baa1370f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:05.421716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e327fef2-936e-4e31-9a3c-9a43baa1370f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:05.429981 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e327fef2-936e-4e31-9a3c-9a43baa1370f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.158190 May 13 13:29:05.430533 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 254/532] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:05 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:05.711366 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d90b42e3-310a-4609-aedb-bda0c8712e63 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:05.711986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d90b42e3-310a-4609-aedb-bda0c8712e63 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:05.719229 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d90b42e3-310a-4609-aedb-bda0c8712e63 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:05.719677 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d90b42e3-310a-4609-aedb-bda0c8712e63 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:05.720467 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d90b42e3-310a-4609-aedb-bda0c8712e63 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:05.720957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d90b42e3-310a-4609-aedb-bda0c8712e63 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:05.733061 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e846f8c9-1e72-49bc-ab67-a39b8f477214 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:05.735140 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e846f8c9-1e72-49bc-ab67-a39b8f477214 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:05.741111 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e846f8c9-1e72-49bc-ab67-a39b8f477214 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:05.741633 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e846f8c9-1e72-49bc-ab67-a39b8f477214 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:05.742434 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e846f8c9-1e72-49bc-ab67-a39b8f477214 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:05.742868 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e846f8c9-1e72-49bc-ab67-a39b8f477214 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:05.859755 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d90b42e3-310a-4609-aedb-bda0c8712e63 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:05.867309 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d90b42e3-310a-4609-aedb-bda0c8712e63 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.159718 May 13 13:29:05.868051 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 279/533] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:05 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:05.878252 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e846f8c9-1e72-49bc-ab67-a39b8f477214 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:05.884353 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e846f8c9-1e72-49bc-ab67-a39b8f477214 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1546 microversion: 2.1 time: 0.155719 May 13 13:29:05.884949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 255/534] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:05 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:05.901467 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-14fbf9e6-747b-40c7-a5ae-c32da0ad58c6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:05.902187 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-14fbf9e6-747b-40c7-a5ae-c32da0ad58c6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:05.909070 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14fbf9e6-747b-40c7-a5ae-c32da0ad58c6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:05.909700 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14fbf9e6-747b-40c7-a5ae-c32da0ad58c6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:05.910699 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14fbf9e6-747b-40c7-a5ae-c32da0ad58c6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:05.911153 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14fbf9e6-747b-40c7-a5ae-c32da0ad58c6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:06.078916 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-14fbf9e6-747b-40c7-a5ae-c32da0ad58c6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:06.083940 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-14fbf9e6-747b-40c7-a5ae-c32da0ad58c6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1546 microversion: 2.1 time: 0.186190 May 13 13:29:06.084520 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 280/535] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:05 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1546 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:06.101063 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6a5f68ee-465f-46cf-b72c-5fe5f54919b7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:06.105313 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6a5f68ee-465f-46cf-b72c-5fe5f54919b7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:06.106150 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6a5f68ee-465f-46cf-b72c-5fe5f54919b7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Searching by: {'deleted': False, 'project_id': '1503b2654ff7475b98032519919ae481'} {{(pid=117602) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 13 13:29:06.113395 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6a5f68ee-465f-46cf-b72c-5fe5f54919b7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:06.113886 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6a5f68ee-465f-46cf-b72c-5fe5f54919b7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:06.114698 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6a5f68ee-465f-46cf-b72c-5fe5f54919b7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:06.115143 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6a5f68ee-465f-46cf-b72c-5fe5f54919b7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:06.215212 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.multi_cell_list [None req-6a5f68ee-465f-46cf-b72c-5fe5f54919b7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117602) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 13 13:29:06.311699 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6a5f68ee-465f-46cf-b72c-5fe5f54919b7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.214688 May 13 13:29:06.312324 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 256/536] 10.222.0.25 () {58 vars in 1124 bytes} [Fri May 13 13:29:06 2022] GET /compute/v2.1/servers => generated 342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:06.322825 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c449c507-0fb9-4406-b23e-dcaea54e5529 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:06.323436 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c449c507-0fb9-4406-b23e-dcaea54e5529 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:06.330443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c449c507-0fb9-4406-b23e-dcaea54e5529 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:06.330812 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c449c507-0fb9-4406-b23e-dcaea54e5529 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:06.331590 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c449c507-0fb9-4406-b23e-dcaea54e5529 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:06.332022 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c449c507-0fb9-4406-b23e-dcaea54e5529 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:06.447491 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-21c0a3c2-6af5-4ae2-afea-f0ebb7c75c9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:06.448849 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-21c0a3c2-6af5-4ae2-afea-f0ebb7c75c9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:06.461682 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21c0a3c2-6af5-4ae2-afea-f0ebb7c75c9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:06.463448 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21c0a3c2-6af5-4ae2-afea-f0ebb7c75c9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:06.470407 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21c0a3c2-6af5-4ae2-afea-f0ebb7c75c9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:06.470407 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21c0a3c2-6af5-4ae2-afea-f0ebb7c75c9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:06.520554 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c449c507-0fb9-4406-b23e-dcaea54e5529 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:06.528017 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c449c507-0fb9-4406-b23e-dcaea54e5529 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1546 microversion: 2.1 time: 0.209343 May 13 13:29:06.528743 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 281/537] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:06 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1546 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:06.627719 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-21c0a3c2-6af5-4ae2-afea-f0ebb7c75c9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:06.635679 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-21c0a3c2-6af5-4ae2-afea-f0ebb7c75c9e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.192374 May 13 13:29:06.636330 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 257/538] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:06 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:06.885101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-924c5ee0-200d-4dc2-bf23-759aeadd3f96 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:06.885669 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-924c5ee0-200d-4dc2-bf23-759aeadd3f96 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:06.891862 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-924c5ee0-200d-4dc2-bf23-759aeadd3f96 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:06.892323 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-924c5ee0-200d-4dc2-bf23-759aeadd3f96 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:06.893144 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-924c5ee0-200d-4dc2-bf23-759aeadd3f96 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:06.893584 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-924c5ee0-200d-4dc2-bf23-759aeadd3f96 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:07.034181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-924c5ee0-200d-4dc2-bf23-759aeadd3f96 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:07.042058 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-924c5ee0-200d-4dc2-bf23-759aeadd3f96 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.161383 May 13 13:29:07.042629 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 282/539] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:06 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:07.653192 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-505c1b74-f817-48d6-96c6-c2df7e4adb27 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:07.653927 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-505c1b74-f817-48d6-96c6-c2df7e4adb27 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:07.660745 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-505c1b74-f817-48d6-96c6-c2df7e4adb27 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:07.661195 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-505c1b74-f817-48d6-96c6-c2df7e4adb27 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:07.661992 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-505c1b74-f817-48d6-96c6-c2df7e4adb27 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:07.662427 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-505c1b74-f817-48d6-96c6-c2df7e4adb27 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:07.792650 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-505c1b74-f817-48d6-96c6-c2df7e4adb27 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:07.801295 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-505c1b74-f817-48d6-96c6-c2df7e4adb27 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.151948 May 13 13:29:07.801930 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 258/540] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:07 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:08.059481 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-50b2459b-669c-400f-8158-dc64cc9c2a32 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:08.060170 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-50b2459b-669c-400f-8158-dc64cc9c2a32 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:08.066193 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-50b2459b-669c-400f-8158-dc64cc9c2a32 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:08.066689 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-50b2459b-669c-400f-8158-dc64cc9c2a32 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:08.067478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-50b2459b-669c-400f-8158-dc64cc9c2a32 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:08.067924 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-50b2459b-669c-400f-8158-dc64cc9c2a32 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:08.193897 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-50b2459b-669c-400f-8158-dc64cc9c2a32 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:08.202920 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-50b2459b-669c-400f-8158-dc64cc9c2a32 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.147377 May 13 13:29:08.203499 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 283/541] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:08 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:08.818973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ea8831e3-f2c3-4cdc-9be1-9e33af2e0336 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:08.819572 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ea8831e3-f2c3-4cdc-9be1-9e33af2e0336 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:08.826670 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ea8831e3-f2c3-4cdc-9be1-9e33af2e0336 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:08.827432 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ea8831e3-f2c3-4cdc-9be1-9e33af2e0336 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:08.828770 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ea8831e3-f2c3-4cdc-9be1-9e33af2e0336 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:08.829208 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ea8831e3-f2c3-4cdc-9be1-9e33af2e0336 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:08.974029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ea8831e3-f2c3-4cdc-9be1-9e33af2e0336 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:08.982068 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ea8831e3-f2c3-4cdc-9be1-9e33af2e0336 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.166920 May 13 13:29:08.985078 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 259/542] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:08 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:09.220408 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a229c627-d85a-4b41-823a-acbbce9b2253 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:09.221527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a229c627-d85a-4b41-823a-acbbce9b2253 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:09.227900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a229c627-d85a-4b41-823a-acbbce9b2253 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:09.228359 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a229c627-d85a-4b41-823a-acbbce9b2253 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:09.229143 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a229c627-d85a-4b41-823a-acbbce9b2253 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:09.229583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a229c627-d85a-4b41-823a-acbbce9b2253 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:09.364113 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a229c627-d85a-4b41-823a-acbbce9b2253 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:09.372041 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a229c627-d85a-4b41-823a-acbbce9b2253 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.156048 May 13 13:29:09.372617 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 284/543] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:09 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:10.001117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-308d5b32-c9a2-4829-ae38-60f6d0790d99 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:10.001894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-308d5b32-c9a2-4829-ae38-60f6d0790d99 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:10.009535 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-308d5b32-c9a2-4829-ae38-60f6d0790d99 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:10.010026 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-308d5b32-c9a2-4829-ae38-60f6d0790d99 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:10.010964 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-308d5b32-c9a2-4829-ae38-60f6d0790d99 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:10.011411 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-308d5b32-c9a2-4829-ae38-60f6d0790d99 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:10.147063 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-308d5b32-c9a2-4829-ae38-60f6d0790d99 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:10.155761 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-308d5b32-c9a2-4829-ae38-60f6d0790d99 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.159521 May 13 13:29:10.157238 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 260/544] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:09 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:10.389014 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-360dc906-8d2d-4c15-8b94-d4ef14adcbc7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:10.389648 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-360dc906-8d2d-4c15-8b94-d4ef14adcbc7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:10.396169 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-360dc906-8d2d-4c15-8b94-d4ef14adcbc7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:10.396623 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-360dc906-8d2d-4c15-8b94-d4ef14adcbc7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:10.397399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-360dc906-8d2d-4c15-8b94-d4ef14adcbc7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:10.397864 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-360dc906-8d2d-4c15-8b94-d4ef14adcbc7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:10.539067 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-360dc906-8d2d-4c15-8b94-d4ef14adcbc7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:10.546437 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-360dc906-8d2d-4c15-8b94-d4ef14adcbc7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.161422 May 13 13:29:10.547056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 285/545] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:10 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:10.603212 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-21782393-85c0-4a29-adb2-f8a112417ccf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36cbabf0-84ef-44b7-80fe-d43fc295534b"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:10.604327 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-21782393-85c0-4a29-adb2-f8a112417ccf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:10.610634 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21782393-85c0-4a29-adb2-f8a112417ccf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:10.611092 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21782393-85c0-4a29-adb2-f8a112417ccf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:10.611873 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21782393-85c0-4a29-adb2-f8a112417ccf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:10.612321 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21782393-85c0-4a29-adb2-f8a112417ccf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:10.685932 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1505182191", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "networks": [{"uuid": "0b9976ff-cf79-4330-8132-342b84c98512"}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:10.738248 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] validate_networks() for [('0b9976ff-cf79-4330-8132-342b84c98512', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:29:11.095817 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:29:11.096288 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:29:11.096706 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:29:11.097110 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:29:11.097513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:29:11.106605 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:11.107058 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:11.108355 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:11.108837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:11.126189 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Getting quotas for project b361133457c04e2da4c4158a45bbcf19. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:29:11.130181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Getting quotas for user 15932bb7b3044a41942b4e0edecebf10 and project b361133457c04e2da4c4158a45bbcf19. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:29:11.140925 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:29:11.143188 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:29:11.286793 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-dffd0ca2-ccb0-413e-8590-0eb7acbd222d tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604479 May 13 13:29:11.287617 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 286/546] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:29:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:29:11.287617 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fb8058f1-d316-454f-ba1f-257853bc359c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:11.287617 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fb8058f1-d316-454f-ba1f-257853bc359c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:11.300127 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fb8058f1-d316-454f-ba1f-257853bc359c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:11.300595 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fb8058f1-d316-454f-ba1f-257853bc359c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:11.301373 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fb8058f1-d316-454f-ba1f-257853bc359c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:11.301947 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fb8058f1-d316-454f-ba1f-257853bc359c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:11.455238 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fb8058f1-d316-454f-ba1f-257853bc359c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:11.463793 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fb8058f1-d316-454f-ba1f-257853bc359c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.175153 May 13 13:29:11.464468 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 287/547] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:11 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:11.472169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-21782393-85c0-4a29-adb2-f8a112417ccf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "POST /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.872365 May 13 13:29:11.473631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 261/548] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:29:10 2022] POST /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:11.480448 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-678fad9e-33bf-40ef-b259-6a4e361783d0 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:11.481504 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-678fad9e-33bf-40ef-b259-6a4e361783d0 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:11.538517 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-678fad9e-33bf-40ef-b259-6a4e361783d0 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:11.545088 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-678fad9e-33bf-40ef-b259-6a4e361783d0 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1219 microversion: 2.1 time: 0.079631 May 13 13:29:11.545643 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 288/549] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:11 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:11.564086 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c439155f-da8d-4d3b-ad07-4606786f705c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:11.564803 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c439155f-da8d-4d3b-ad07-4606786f705c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:11.571232 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c439155f-da8d-4d3b-ad07-4606786f705c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:11.573124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c439155f-da8d-4d3b-ad07-4606786f705c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:11.573124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c439155f-da8d-4d3b-ad07-4606786f705c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:11.573124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c439155f-da8d-4d3b-ad07-4606786f705c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:11.712583 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c439155f-da8d-4d3b-ad07-4606786f705c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:11.720261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c439155f-da8d-4d3b-ad07-4606786f705c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.160903 May 13 13:29:11.720817 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 262/550] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:11 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:12.484064 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2301bfec-1440-47b0-9c6e-b563c4cc6ca0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:12.484851 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2301bfec-1440-47b0-9c6e-b563c4cc6ca0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:12.491989 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2301bfec-1440-47b0-9c6e-b563c4cc6ca0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:12.492438 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2301bfec-1440-47b0-9c6e-b563c4cc6ca0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:12.493211 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2301bfec-1440-47b0-9c6e-b563c4cc6ca0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:12.493691 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2301bfec-1440-47b0-9c6e-b563c4cc6ca0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:12.562215 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-180737d8-33b9-4d73-899a-8aea64d8a154 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:12.562818 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-180737d8-33b9-4d73-899a-8aea64d8a154 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:12.569851 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-180737d8-33b9-4d73-899a-8aea64d8a154 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:12.570320 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-180737d8-33b9-4d73-899a-8aea64d8a154 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:12.571397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-180737d8-33b9-4d73-899a-8aea64d8a154 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:12.571956 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-180737d8-33b9-4d73-899a-8aea64d8a154 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:12.644022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-180737d8-33b9-4d73-899a-8aea64d8a154 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:12.644137 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2301bfec-1440-47b0-9c6e-b563c4cc6ca0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:12.649154 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-180737d8-33b9-4d73-899a-8aea64d8a154 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1223 microversion: 2.1 time: 0.091066 May 13 13:29:12.650516 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 263/551] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:12 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:12.652647 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2301bfec-1440-47b0-9c6e-b563c4cc6ca0 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.174127 May 13 13:29:12.660194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 289/552] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:12 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:12.736666 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a8a9a628-fd51-43f1-bee8-603daf0a183c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:12.737284 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a8a9a628-fd51-43f1-bee8-603daf0a183c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:12.743402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8a9a628-fd51-43f1-bee8-603daf0a183c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:12.743858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8a9a628-fd51-43f1-bee8-603daf0a183c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:12.744635 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8a9a628-fd51-43f1-bee8-603daf0a183c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:12.745074 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8a9a628-fd51-43f1-bee8-603daf0a183c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:12.875561 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a8a9a628-fd51-43f1-bee8-603daf0a183c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:12.883190 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a8a9a628-fd51-43f1-bee8-603daf0a183c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.150436 May 13 13:29:12.883763 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 264/553] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:12 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:13.667215 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cdc3fc40-902a-43ef-ad71-592092294c50 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:13.667837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cdc3fc40-902a-43ef-ad71-592092294c50 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:13.670083 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6b61c98d-cf30-499c-b60f-5f7a061b621f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:13.670748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6b61c98d-cf30-499c-b60f-5f7a061b621f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:13.674102 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cdc3fc40-902a-43ef-ad71-592092294c50 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:13.674635 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cdc3fc40-902a-43ef-ad71-592092294c50 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:13.675485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cdc3fc40-902a-43ef-ad71-592092294c50 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:13.675997 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cdc3fc40-902a-43ef-ad71-592092294c50 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:13.676996 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6b61c98d-cf30-499c-b60f-5f7a061b621f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:13.677565 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6b61c98d-cf30-499c-b60f-5f7a061b621f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:13.678358 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6b61c98d-cf30-499c-b60f-5f7a061b621f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:13.678792 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6b61c98d-cf30-499c-b60f-5f7a061b621f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:13.738140 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cdc3fc40-902a-43ef-ad71-592092294c50 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:13.745667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cdc3fc40-902a-43ef-ad71-592092294c50 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1215 microversion: 2.1 time: 0.082651 May 13 13:29:13.746276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 290/554] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:13 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:13.811864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6b61c98d-cf30-499c-b60f-5f7a061b621f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:13.819637 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6b61c98d-cf30-499c-b60f-5f7a061b621f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.153359 May 13 13:29:13.820195 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 265/555] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:13 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:13.900459 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8186c9a7-5bd5-4903-884d-3713b8373602 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:13.901069 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8186c9a7-5bd5-4903-884d-3713b8373602 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:13.907723 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8186c9a7-5bd5-4903-884d-3713b8373602 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:13.908173 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8186c9a7-5bd5-4903-884d-3713b8373602 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:13.909355 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8186c9a7-5bd5-4903-884d-3713b8373602 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:13.909806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8186c9a7-5bd5-4903-884d-3713b8373602 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:14.043091 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8186c9a7-5bd5-4903-884d-3713b8373602 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:14.050453 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8186c9a7-5bd5-4903-884d-3713b8373602 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.154054 May 13 13:29:14.051016 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 291/556] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:13 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:14.762601 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8d9ca6ac-6809-4640-9be1-8cba9f58f5a2 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:14.763351 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8d9ca6ac-6809-4640-9be1-8cba9f58f5a2 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:14.770426 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8d9ca6ac-6809-4640-9be1-8cba9f58f5a2 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:14.770873 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8d9ca6ac-6809-4640-9be1-8cba9f58f5a2 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:14.771660 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8d9ca6ac-6809-4640-9be1-8cba9f58f5a2 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:14.772093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8d9ca6ac-6809-4640-9be1-8cba9f58f5a2 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:14.837561 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-82f9eb91-46d2-4af7-b02f-209b20a90bf3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:14.838293 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-82f9eb91-46d2-4af7-b02f-209b20a90bf3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:14.846638 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-82f9eb91-46d2-4af7-b02f-209b20a90bf3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:14.846937 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-8d9ca6ac-6809-4640-9be1-8cba9f58f5a2 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:14.847067 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-82f9eb91-46d2-4af7-b02f-209b20a90bf3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:14.847067 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-82f9eb91-46d2-4af7-b02f-209b20a90bf3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:14.847067 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-82f9eb91-46d2-4af7-b02f-209b20a90bf3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:14.852316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8d9ca6ac-6809-4640-9be1-8cba9f58f5a2 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1215 microversion: 2.1 time: 0.093515 May 13 13:29:14.853080 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 266/557] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:14 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:14.977300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-82f9eb91-46d2-4af7-b02f-209b20a90bf3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:14.986081 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-82f9eb91-46d2-4af7-b02f-209b20a90bf3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.152245 May 13 13:29:14.986752 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 292/558] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:14 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:15.070408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-183b4b31-6d12-4011-8226-a2d047664ef3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:15.070999 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-183b4b31-6d12-4011-8226-a2d047664ef3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:15.077691 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-183b4b31-6d12-4011-8226-a2d047664ef3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.078172 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-183b4b31-6d12-4011-8226-a2d047664ef3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.078968 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-183b4b31-6d12-4011-8226-a2d047664ef3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.079448 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-183b4b31-6d12-4011-8226-a2d047664ef3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.215107 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-183b4b31-6d12-4011-8226-a2d047664ef3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:15.222510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-183b4b31-6d12-4011-8226-a2d047664ef3 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.158355 May 13 13:29:15.223079 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 267/559] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:15 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:15.868313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-125422cd-55f5-4133-970d-adcf789b228d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:15.873029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-32fb0eee-1c16-48ca-9eab-31d898d70419 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:15.874011 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-125422cd-55f5-4133-970d-adcf789b228d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:15.874120 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-32fb0eee-1c16-48ca-9eab-31d898d70419 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:15.876332 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-125422cd-55f5-4133-970d-adcf789b228d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.876661 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-32fb0eee-1c16-48ca-9eab-31d898d70419 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.876826 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-125422cd-55f5-4133-970d-adcf789b228d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.877166 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-32fb0eee-1c16-48ca-9eab-31d898d70419 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.877615 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-125422cd-55f5-4133-970d-adcf789b228d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.878003 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-32fb0eee-1c16-48ca-9eab-31d898d70419 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:15.878250 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-125422cd-55f5-4133-970d-adcf789b228d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.878447 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-32fb0eee-1c16-48ca-9eab-31d898d70419 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:15.944130 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-32fb0eee-1c16-48ca-9eab-31d898d70419 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:15.952616 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-32fb0eee-1c16-48ca-9eab-31d898d70419 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1279 microversion: 2.1 time: 0.087433 May 13 13:29:15.953197 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 268/560] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:15 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1279 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:16.003780 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9d93c9e4-d6f1-4259-9119-a24d81bbb164 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:16.009921 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-9d93c9e4-d6f1-4259-9119-a24d81bbb164 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:16.011954 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9d93c9e4-d6f1-4259-9119-a24d81bbb164 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:16.012663 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9d93c9e4-d6f1-4259-9119-a24d81bbb164 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:16.013916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9d93c9e4-d6f1-4259-9119-a24d81bbb164 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:16.014547 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9d93c9e4-d6f1-4259-9119-a24d81bbb164 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:16.020250 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-125422cd-55f5-4133-970d-adcf789b228d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:16.033608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-125422cd-55f5-4133-970d-adcf789b228d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1592 microversion: 2.1 time: 0.169358 May 13 13:29:16.034367 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 293/561] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:15 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1592 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:16.165053 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-9d93c9e4-d6f1-4259-9119-a24d81bbb164 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:16.175777 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-9d93c9e4-d6f1-4259-9119-a24d81bbb164 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.175793 May 13 13:29:16.176956 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 269/562] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:15 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:16.241815 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-622af4d1-4980-49d4-9a5a-085d5705a362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:16.242137 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-622af4d1-4980-49d4-9a5a-085d5705a362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:16.248881 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-622af4d1-4980-49d4-9a5a-085d5705a362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:16.249882 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-622af4d1-4980-49d4-9a5a-085d5705a362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:16.251102 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-622af4d1-4980-49d4-9a5a-085d5705a362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:16.252319 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-622af4d1-4980-49d4-9a5a-085d5705a362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:16.453294 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-622af4d1-4980-49d4-9a5a-085d5705a362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:16.466794 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-622af4d1-4980-49d4-9a5a-085d5705a362 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.229318 May 13 13:29:16.476405 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 294/563] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:16 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:16.678150 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1504514014", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1357767532", "security_groups": [{"name": "tempest-secgroup-smoke-854436485"}], "block_device_mapping_v2": [{"uuid": "2c5c503b-159b-4d19-8a00-fe8ee658985e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c9600aa-af97-422e-b469-899e3d008792"}]}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:16.840563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.network.neutron [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] validate_networks() for [('6c9600aa-af97-422e-b469-899e3d008792', None, None, None, None, None)] {{(pid=117602) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:29:16.983577 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2d507e06-ab2b-443c-974c-3ecea9ce9d13 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:16.984191 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2d507e06-ab2b-443c-974c-3ecea9ce9d13 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:16.990611 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2d507e06-ab2b-443c-974c-3ecea9ce9d13 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:16.991079 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2d507e06-ab2b-443c-974c-3ecea9ce9d13 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:16.991868 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2d507e06-ab2b-443c-974c-3ecea9ce9d13 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:16.992309 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2d507e06-ab2b-443c-974c-3ecea9ce9d13 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.241970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2d507e06-ab2b-443c-974c-3ecea9ce9d13 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:17.250231 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2d507e06-ab2b-443c-974c-3ecea9ce9d13 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1319 microversion: 2.1 time: 0.270670 May 13 13:29:17.250799 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 295/564] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:16 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:17.256029 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e47071d4-7032-429f-b9a0-96364f6dbbaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:17.257121 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e47071d4-7032-429f-b9a0-96364f6dbbaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:17.262879 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e47071d4-7032-429f-b9a0-96364f6dbbaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.263545 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e47071d4-7032-429f-b9a0-96364f6dbbaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.265024 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e47071d4-7032-429f-b9a0-96364f6dbbaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.265452 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e47071d4-7032-429f-b9a0-96364f6dbbaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.399991 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e47071d4-7032-429f-b9a0-96364f6dbbaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:17.410885 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e47071d4-7032-429f-b9a0-96364f6dbbaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.157741 May 13 13:29:17.411495 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 296/565] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:17 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:17.484354 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d284f128-4331-4270-a37a-ca02e875e833 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:17.489160 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d284f128-4331-4270-a37a-ca02e875e833 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:17.492098 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d284f128-4331-4270-a37a-ca02e875e833 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.493092 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d284f128-4331-4270-a37a-ca02e875e833 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.493917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d284f128-4331-4270-a37a-ca02e875e833 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.498385 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d284f128-4331-4270-a37a-ca02e875e833 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.551679 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Flavor limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:29:17.555032 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Image limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:29:17.555527 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Flavor pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:29:17.555935 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Image pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:29:17.556345 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:29:17.565625 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.566111 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.566915 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.567344 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.589422 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Getting quotas for project d3e32e04d1f44e97b903f98c7c2749db. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:29:17.594380 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Getting quotas for user 8101850dd18f4108ac12ff9487cbbe3e and project d3e32e04d1f44e97b903f98c7c2749db. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:29:17.655823 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Going to run 1 instances... {{(pid=117602) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:29:17.658763 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c5c503b-159b-4d19-8a00-fe8ee658985e',volume_size=None,volume_type=None)] {{(pid=117602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:29:17.684982 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d284f128-4331-4270-a37a-ca02e875e833 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:17.693578 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d284f128-4331-4270-a37a-ca02e875e833 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.213357 May 13 13:29:17.694178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 297/566] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:17 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:17.831028 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-56048f8e-4eb7-4837-ac80-fb99dec09624 req-0deb5e5e-e060-422d-9fed-394b0b25c487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16a2ed3f-3b98-4052-9f7f-934179a73cbe", "tag": "2e260ecb-d92a-4742-8e06-f69dee207767"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:17.839319 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-56048f8e-4eb7-4837-ac80-fb99dec09624 req-0deb5e5e-e060-422d-9fed-394b0b25c487 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:17.839976 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-56048f8e-4eb7-4837-ac80-fb99dec09624 req-0deb5e5e-e060-422d-9fed-394b0b25c487 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:17.852843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-56048f8e-4eb7-4837-ac80-fb99dec09624 req-0deb5e5e-e060-422d-9fed-394b0b25c487 service nova] Creating event network-changed:2e260ecb-d92a-4742-8e06-f69dee207767 for instance 16a2ed3f-3b98-4052-9f7f-934179a73cbe on hv-cinder-84159 May 13 13:29:17.858773 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-56048f8e-4eb7-4837-ac80-fb99dec09624 req-0deb5e5e-e060-422d-9fed-394b0b25c487 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032289 May 13 13:29:17.859604 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 298/567] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:18.272994 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9a602656-d24c-444a-9c99-1a64050f017c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:18.272994 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9a602656-d24c-444a-9c99-1a64050f017c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:18.273655 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-332b20eb-f67e-42c6-8b2d-25fec8e475e9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.597805 May 13 13:29:18.277133 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a602656-d24c-444a-9c99-1a64050f017c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:18.278210 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 270/568] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:29:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:29:18.278565 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a602656-d24c-444a-9c99-1a64050f017c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:18.280165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a602656-d24c-444a-9c99-1a64050f017c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:18.280835 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9a602656-d24c-444a-9c99-1a64050f017c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:18.284048 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c2561d3f-e1ce-4d93-9af8-484d899537ce tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:18.284660 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c2561d3f-e1ce-4d93-9af8-484d899537ce tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:18.343074 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c2561d3f-e1ce-4d93-9af8-484d899537ce tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:18.350315 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c2561d3f-e1ce-4d93-9af8-484d899537ce tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1095 microversion: 2.1 time: 0.070925 May 13 13:29:18.351141 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 271/569] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:18 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:18.428336 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-80932011-fdff-4986-bba7-530a8c8ac14f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:18.428945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-80932011-fdff-4986-bba7-530a8c8ac14f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:18.440800 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-80932011-fdff-4986-bba7-530a8c8ac14f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:18.441154 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-80932011-fdff-4986-bba7-530a8c8ac14f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:18.441993 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-80932011-fdff-4986-bba7-530a8c8ac14f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:18.443031 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-80932011-fdff-4986-bba7-530a8c8ac14f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:18.701346 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-80932011-fdff-4986-bba7-530a8c8ac14f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:18.712990 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-80932011-fdff-4986-bba7-530a8c8ac14f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.288480 May 13 13:29:18.721095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 272/570] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:18 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:18.721095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-11b1e0f3-39c9-4a88-8107-8fc0e7feb9e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:18.721095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-11b1e0f3-39c9-4a88-8107-8fc0e7feb9e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:18.724920 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-11b1e0f3-39c9-4a88-8107-8fc0e7feb9e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:18.725383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-11b1e0f3-39c9-4a88-8107-8fc0e7feb9e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:18.726240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-11b1e0f3-39c9-4a88-8107-8fc0e7feb9e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:18.726683 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-11b1e0f3-39c9-4a88-8107-8fc0e7feb9e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:18.764511 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9a602656-d24c-444a-9c99-1a64050f017c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:18.774569 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9a602656-d24c-444a-9c99-1a64050f017c tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1319 microversion: 2.1 time: 0.510125 May 13 13:29:18.775891 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 299/571] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:18 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:18.953475 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-11b1e0f3-39c9-4a88-8107-8fc0e7feb9e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:18.960870 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-11b1e0f3-39c9-4a88-8107-8fc0e7feb9e4 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.245815 May 13 13:29:18.961438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 273/572] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:18 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:19.240116 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-21860cae-fcee-4438-9489-64324df1572e req-39a47d37-2ee8-437c-8184-12f5d01b122d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92bf6a17-fa9f-410e-b25d-4053de456900", "tag": "77185538-d455-4ce8-942b-c0fc75b37ded"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:19.257395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-21860cae-fcee-4438-9489-64324df1572e req-39a47d37-2ee8-437c-8184-12f5d01b122d service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:19.262489 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-21860cae-fcee-4438-9489-64324df1572e req-39a47d37-2ee8-437c-8184-12f5d01b122d service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:19.274722 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-21860cae-fcee-4438-9489-64324df1572e req-39a47d37-2ee8-437c-8184-12f5d01b122d service nova] Creating event network-changed:77185538-d455-4ce8-942b-c0fc75b37ded for instance 92bf6a17-fa9f-410e-b25d-4053de456900 on hv-cinder-84159 May 13 13:29:19.280156 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-21860cae-fcee-4438-9489-64324df1572e req-39a47d37-2ee8-437c-8184-12f5d01b122d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043792 May 13 13:29:19.281545 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 300/573] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:19.367483 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-04f68368-59c7-4677-baf1-aacb6d15f44c tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:19.368290 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-04f68368-59c7-4677-baf1-aacb6d15f44c tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:19.429155 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-04f68368-59c7-4677-baf1-aacb6d15f44c tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:19.436653 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-04f68368-59c7-4677-baf1-aacb6d15f44c tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1095 microversion: 2.1 time: 0.073108 May 13 13:29:19.437241 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 274/574] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:19 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:19.730402 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-11e7fe2b-7989-4f94-8f58-a5a4663d3614 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:19.731110 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-11e7fe2b-7989-4f94-8f58-a5a4663d3614 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:19.737358 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11e7fe2b-7989-4f94-8f58-a5a4663d3614 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:19.737854 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11e7fe2b-7989-4f94-8f58-a5a4663d3614 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:19.738723 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11e7fe2b-7989-4f94-8f58-a5a4663d3614 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:19.739176 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-11e7fe2b-7989-4f94-8f58-a5a4663d3614 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:19.792952 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9bbbb429-d4ab-47d1-9552-892581bdc3ad tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:19.793727 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-9bbbb429-d4ab-47d1-9552-892581bdc3ad tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:19.802632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9bbbb429-d4ab-47d1-9552-892581bdc3ad tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:19.802632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9bbbb429-d4ab-47d1-9552-892581bdc3ad tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:19.802632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9bbbb429-d4ab-47d1-9552-892581bdc3ad tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:19.802632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9bbbb429-d4ab-47d1-9552-892581bdc3ad tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:19.890349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-11e7fe2b-7989-4f94-8f58-a5a4663d3614 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:19.899441 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-11e7fe2b-7989-4f94-8f58-a5a4663d3614 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.173313 May 13 13:29:19.900302 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 301/575] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:19 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:19.958924 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-9bbbb429-d4ab-47d1-9552-892581bdc3ad tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:19.967428 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-9bbbb429-d4ab-47d1-9552-892581bdc3ad tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1319 microversion: 2.1 time: 0.178007 May 13 13:29:19.967428 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 275/576] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:19 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:19.985653 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-85ee4497-cdb4-4276-8b32-a964b9195496 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:19.985653 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-85ee4497-cdb4-4276-8b32-a964b9195496 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:19.988454 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-85ee4497-cdb4-4276-8b32-a964b9195496 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:19.989137 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-85ee4497-cdb4-4276-8b32-a964b9195496 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:19.990005 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-85ee4497-cdb4-4276-8b32-a964b9195496 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:19.990778 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-85ee4497-cdb4-4276-8b32-a964b9195496 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:20.128121 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-85ee4497-cdb4-4276-8b32-a964b9195496 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:20.136065 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-85ee4497-cdb4-4276-8b32-a964b9195496 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1677 microversion: 2.1 time: 0.158134 May 13 13:29:20.136639 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 302/577] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:19 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:20.454015 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2b8a2f6b-0782-4db3-8ee4-8f8b8e02f454 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:20.454894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2b8a2f6b-0782-4db3-8ee4-8f8b8e02f454 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:20.461201 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2b8a2f6b-0782-4db3-8ee4-8f8b8e02f454 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:20.461684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2b8a2f6b-0782-4db3-8ee4-8f8b8e02f454 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:20.462563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2b8a2f6b-0782-4db3-8ee4-8f8b8e02f454 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:20.463006 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2b8a2f6b-0782-4db3-8ee4-8f8b8e02f454 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:20.532888 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2b8a2f6b-0782-4db3-8ee4-8f8b8e02f454 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:20.540242 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2b8a2f6b-0782-4db3-8ee4-8f8b8e02f454 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1145 microversion: 2.1 time: 0.091043 May 13 13:29:20.540805 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 276/578] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:20 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:20.916692 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-730c4eff-7378-488d-a463-42a0eb5ff7c1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:20.917368 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-730c4eff-7378-488d-a463-42a0eb5ff7c1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:20.923515 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-730c4eff-7378-488d-a463-42a0eb5ff7c1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:20.923977 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-730c4eff-7378-488d-a463-42a0eb5ff7c1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:20.924748 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-730c4eff-7378-488d-a463-42a0eb5ff7c1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:20.925190 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-730c4eff-7378-488d-a463-42a0eb5ff7c1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:20.983110 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-547f105b-8ff5-41aa-9f66-a8174c77420a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:20.983719 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-547f105b-8ff5-41aa-9f66-a8174c77420a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:20.990631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-547f105b-8ff5-41aa-9f66-a8174c77420a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:20.991104 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-547f105b-8ff5-41aa-9f66-a8174c77420a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:20.991895 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-547f105b-8ff5-41aa-9f66-a8174c77420a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:20.992357 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-547f105b-8ff5-41aa-9f66-a8174c77420a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:21.118485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-730c4eff-7378-488d-a463-42a0eb5ff7c1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:21.122414 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-730c4eff-7378-488d-a463-42a0eb5ff7c1 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.209678 May 13 13:29:21.122992 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 303/579] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:20 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:21.134903 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-547f105b-8ff5-41aa-9f66-a8174c77420a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:21.142791 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-547f105b-8ff5-41aa-9f66-a8174c77420a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1319 microversion: 2.1 time: 0.163666 May 13 13:29:21.143367 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 277/580] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:20 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:21.152212 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-13ea96d8-3079-4c9a-a610-ec8eb5224860 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:21.152824 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-13ea96d8-3079-4c9a-a610-ec8eb5224860 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:21.159304 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-13ea96d8-3079-4c9a-a610-ec8eb5224860 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:21.159757 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-13ea96d8-3079-4c9a-a610-ec8eb5224860 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:21.160525 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-13ea96d8-3079-4c9a-a610-ec8eb5224860 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:21.160964 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-13ea96d8-3079-4c9a-a610-ec8eb5224860 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:21.314873 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-13ea96d8-3079-4c9a-a610-ec8eb5224860 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:21.323224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-13ea96d8-3079-4c9a-a610-ec8eb5224860 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1654 microversion: 2.1 time: 0.174787 May 13 13:29:21.323785 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 304/581] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:21 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1654 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:21.341679 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8849ff9d-b654-4fd3-993e-38b05a3d2f48 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:21.346254 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8849ff9d-b654-4fd3-993e-38b05a3d2f48 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:21.346702 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8849ff9d-b654-4fd3-993e-38b05a3d2f48 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:21.368844 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8849ff9d-b654-4fd3-993e-38b05a3d2f48 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Going to try to start instance {{(pid=117602) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 13:29:21.557698 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3b25b93e-8df7-4cdc-b454-6f89a9c30cd1 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:21.558435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3b25b93e-8df7-4cdc-b454-6f89a9c30cd1 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:21.565155 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b25b93e-8df7-4cdc-b454-6f89a9c30cd1 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:21.565730 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b25b93e-8df7-4cdc-b454-6f89a9c30cd1 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:21.566594 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b25b93e-8df7-4cdc-b454-6f89a9c30cd1 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:21.567111 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b25b93e-8df7-4cdc-b454-6f89a9c30cd1 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:21.645384 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3b25b93e-8df7-4cdc-b454-6f89a9c30cd1 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:21.652695 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3b25b93e-8df7-4cdc-b454-6f89a9c30cd1 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1201 microversion: 2.1 time: 0.098859 May 13 13:29:21.653273 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 305/582] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:21 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1201 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:21.811543 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8849ff9d-b654-4fd3-993e-38b05a3d2f48 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "POST /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/action" status: 202 len: 0 microversion: 2.1 time: 0.474631 May 13 13:29:21.820385 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 278/583] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:29:21 2022] POST /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:29:21.820533 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ca6d4cb8-a644-4e15-a8be-9a616d7f9c0f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:21.820829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ca6d4cb8-a644-4e15-a8be-9a616d7f9c0f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:21.827690 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ca6d4cb8-a644-4e15-a8be-9a616d7f9c0f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:21.828146 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ca6d4cb8-a644-4e15-a8be-9a616d7f9c0f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:21.828917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ca6d4cb8-a644-4e15-a8be-9a616d7f9c0f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:21.829353 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ca6d4cb8-a644-4e15-a8be-9a616d7f9c0f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:21.976998 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ca6d4cb8-a644-4e15-a8be-9a616d7f9c0f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:21.989556 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ca6d4cb8-a644-4e15-a8be-9a616d7f9c0f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1663 microversion: 2.1 time: 0.173115 May 13 13:29:21.996614 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 306/584] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:21 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1663 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:22.140964 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6b69227a-f294-4c9c-8d90-30f0d7694e3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:22.141692 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6b69227a-f294-4c9c-8d90-30f0d7694e3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:22.160467 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6b69227a-f294-4c9c-8d90-30f0d7694e3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:22.160467 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6b69227a-f294-4c9c-8d90-30f0d7694e3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:22.160467 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6b69227a-f294-4c9c-8d90-30f0d7694e3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:22.160467 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6b69227a-f294-4c9c-8d90-30f0d7694e3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:22.161409 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a157e3bb-cde3-4ef8-82a2-fd93497a47d7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:22.162744 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a157e3bb-cde3-4ef8-82a2-fd93497a47d7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:22.170692 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a157e3bb-cde3-4ef8-82a2-fd93497a47d7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:22.171239 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a157e3bb-cde3-4ef8-82a2-fd93497a47d7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:22.172207 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a157e3bb-cde3-4ef8-82a2-fd93497a47d7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:22.172840 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a157e3bb-cde3-4ef8-82a2-fd93497a47d7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:22.412990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a157e3bb-cde3-4ef8-82a2-fd93497a47d7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:22.421436 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a157e3bb-cde3-4ef8-82a2-fd93497a47d7 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1319 microversion: 2.1 time: 0.264904 May 13 13:29:22.432638 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 307/585] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:22 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:22.457202 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6b69227a-f294-4c9c-8d90-30f0d7694e3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:22.472219 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6b69227a-f294-4c9c-8d90-30f0d7694e3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.335900 May 13 13:29:22.477856 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 279/586] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:22 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:22.670079 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-89bb81d3-8cc6-42ea-b271-82d53b231128 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:22.670706 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-89bb81d3-8cc6-42ea-b271-82d53b231128 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:22.688564 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-89bb81d3-8cc6-42ea-b271-82d53b231128 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:22.689026 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-89bb81d3-8cc6-42ea-b271-82d53b231128 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:22.689852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-89bb81d3-8cc6-42ea-b271-82d53b231128 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:22.690301 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-89bb81d3-8cc6-42ea-b271-82d53b231128 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:22.850129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-89bb81d3-8cc6-42ea-b271-82d53b231128 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:22.858496 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-89bb81d3-8cc6-42ea-b271-82d53b231128 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1278 microversion: 2.1 time: 0.192301 May 13 13:29:22.868157 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 308/587] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:22 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:22.946856 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5cf017fa-a544-42bb-88f4-18c23afc7c30 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-787756759"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:22.947398 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-5cf017fa-a544-42bb-88f4-18c23afc7c30 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:22.955650 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5cf017fa-a544-42bb-88f4-18c23afc7c30 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:22.956325 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5cf017fa-a544-42bb-88f4-18c23afc7c30 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:22.957339 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5cf017fa-a544-42bb-88f4-18c23afc7c30 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:22.958050 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5cf017fa-a544-42bb-88f4-18c23afc7c30 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.009664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-929fe9cc-2c1c-4083-afef-d37218a74410 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:23.010316 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-929fe9cc-2c1c-4083-afef-d37218a74410 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:23.016950 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-929fe9cc-2c1c-4083-afef-d37218a74410 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.017830 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-929fe9cc-2c1c-4083-afef-d37218a74410 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.018809 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-929fe9cc-2c1c-4083-afef-d37218a74410 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.020052 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-929fe9cc-2c1c-4083-afef-d37218a74410 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.111403 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.network.security_group_api [None req-5cf017fa-a544-42bb-88f4-18c23afc7c30 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Adding security group a132708f-33d0-4e29-b377-a71de51115ec to port 77185538-d455-4ce8-942b-c0fc75b37ded May 13 13:29:23.262763 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-929fe9cc-2c1c-4083-afef-d37218a74410 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:23.274430 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-929fe9cc-2c1c-4083-afef-d37218a74410 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1663 microversion: 2.1 time: 0.266642 May 13 13:29:23.275029 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 309/588] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:23 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1663 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:23.439894 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6e5c9ece-3f5a-42b3-84ee-488b2bd75b7a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:23.445395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6e5c9ece-3f5a-42b3-84ee-488b2bd75b7a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:23.446690 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6e5c9ece-3f5a-42b3-84ee-488b2bd75b7a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.447179 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6e5c9ece-3f5a-42b3-84ee-488b2bd75b7a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.447969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6e5c9ece-3f5a-42b3-84ee-488b2bd75b7a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.448612 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6e5c9ece-3f5a-42b3-84ee-488b2bd75b7a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.651916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-5cf017fa-a544-42bb-88f4-18c23afc7c30 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "POST /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/action" status: 202 len: 0 microversion: 2.1 time: 0.709123 May 13 13:29:23.652522 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 280/589] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:29:22 2022] POST /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/action => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:29:23.658401 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-bb587d1a-b02f-468a-a178-b1f2a904a9de tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:23.659018 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-bb587d1a-b02f-468a-a178-b1f2a904a9de tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:23.672730 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6e5c9ece-3f5a-42b3-84ee-488b2bd75b7a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:23.674770 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bb587d1a-b02f-468a-a178-b1f2a904a9de tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.675231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bb587d1a-b02f-468a-a178-b1f2a904a9de tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.676025 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bb587d1a-b02f-468a-a178-b1f2a904a9de tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.676466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bb587d1a-b02f-468a-a178-b1f2a904a9de tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.683920 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6e5c9ece-3f5a-42b3-84ee-488b2bd75b7a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1319 microversion: 2.1 time: 0.248423 May 13 13:29:23.684835 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 310/590] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:23 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:23.693705 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3f635036-4de5-4b52-a8f0-e59ba01c4157 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:23.694819 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3f635036-4de5-4b52-a8f0-e59ba01c4157 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:23.701434 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3f635036-4de5-4b52-a8f0-e59ba01c4157 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.702140 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3f635036-4de5-4b52-a8f0-e59ba01c4157 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.703342 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3f635036-4de5-4b52-a8f0-e59ba01c4157 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.703940 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3f635036-4de5-4b52-a8f0-e59ba01c4157 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.856128 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bb587d1a-b02f-468a-a178-b1f2a904a9de tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:23.864784 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-bb587d1a-b02f-468a-a178-b1f2a904a9de tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.210986 May 13 13:29:23.874924 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 281/591] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:23 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:23.874924 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-3d2bff91-3935-4fc7-8e7c-e97ae9f26a92 req-f5a66b9f-ff99-4013-9c37-78ec59c535ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92bf6a17-fa9f-410e-b25d-4053de456900", "tag": "77185538-d455-4ce8-942b-c0fc75b37ded"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:23.879313 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-3d2bff91-3935-4fc7-8e7c-e97ae9f26a92 req-f5a66b9f-ff99-4013-9c37-78ec59c535ca service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.879756 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-3d2bff91-3935-4fc7-8e7c-e97ae9f26a92 req-f5a66b9f-ff99-4013-9c37-78ec59c535ca service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.892600 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-3d2bff91-3935-4fc7-8e7c-e97ae9f26a92 req-f5a66b9f-ff99-4013-9c37-78ec59c535ca service nova] Creating event network-changed:77185538-d455-4ce8-942b-c0fc75b37ded for instance 92bf6a17-fa9f-410e-b25d-4053de456900 on hv-cinder-84159 May 13 13:29:23.901919 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3f635036-4de5-4b52-a8f0-e59ba01c4157 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:23.910708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3f635036-4de5-4b52-a8f0-e59ba01c4157 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1756 microversion: 2.1 time: 0.224631 May 13 13:29:23.911313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 311/592] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:23 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:23.919350 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-3d2bff91-3935-4fc7-8e7c-e97ae9f26a92 req-f5a66b9f-ff99-4013-9c37-78ec59c535ca service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052126 May 13 13:29:23.920558 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 282/593] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:23.931341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f9d56b99-5442-4f2d-8072-786b716ab9ee tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:23.932245 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f9d56b99-5442-4f2d-8072-786b716ab9ee tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:23.939329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9d56b99-5442-4f2d-8072-786b716ab9ee tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.939932 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9d56b99-5442-4f2d-8072-786b716ab9ee tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.940711 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9d56b99-5442-4f2d-8072-786b716ab9ee tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.941162 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9d56b99-5442-4f2d-8072-786b716ab9ee tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.946951 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-f4db42b3-b85b-46da-82a4-28fb17daeff1 req-4dcc72fb-1662-4a67-b767-11152684feee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c", "tag": "d1cd2559-b1b4-466c-9ab5-45773dffdb54"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:23.963011 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-f4db42b3-b85b-46da-82a4-28fb17daeff1 req-4dcc72fb-1662-4a67-b767-11152684feee service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:23.963471 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-f4db42b3-b85b-46da-82a4-28fb17daeff1 req-4dcc72fb-1662-4a67-b767-11152684feee service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:23.974686 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-f4db42b3-b85b-46da-82a4-28fb17daeff1 req-4dcc72fb-1662-4a67-b767-11152684feee service nova] Creating event network-changed:d1cd2559-b1b4-466c-9ab5-45773dffdb54 for instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c on hv-cinder-84159 May 13 13:29:23.979865 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-f4db42b3-b85b-46da-82a4-28fb17daeff1 req-4dcc72fb-1662-4a67-b767-11152684feee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038107 May 13 13:29:23.980547 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 283/594] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:24.173401 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f9d56b99-5442-4f2d-8072-786b716ab9ee tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:24.181929 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f9d56b99-5442-4f2d-8072-786b716ab9ee tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1278 microversion: 2.1 time: 0.253879 May 13 13:29:24.192736 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 312/595] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:23 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1278 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:24.293601 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c9d54db3-0196-4ee7-8491-8135436b5afc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:24.294105 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c9d54db3-0196-4ee7-8491-8135436b5afc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:24.309767 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c9d54db3-0196-4ee7-8491-8135436b5afc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.310252 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c9d54db3-0196-4ee7-8491-8135436b5afc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.311071 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c9d54db3-0196-4ee7-8491-8135436b5afc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.311517 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c9d54db3-0196-4ee7-8491-8135436b5afc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.590155 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c9d54db3-0196-4ee7-8491-8135436b5afc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:24.598805 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c9d54db3-0196-4ee7-8491-8135436b5afc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1667 microversion: 2.1 time: 0.309986 May 13 13:29:24.610975 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 284/596] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:24 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1667 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:24.713434 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fc19a7f9-fa0d-44a1-b68e-a7d8206d3fde tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:24.715476 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fc19a7f9-fa0d-44a1-b68e-a7d8206d3fde tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:24.727102 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc19a7f9-fa0d-44a1-b68e-a7d8206d3fde tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.728742 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc19a7f9-fa0d-44a1-b68e-a7d8206d3fde tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.730954 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc19a7f9-fa0d-44a1-b68e-a7d8206d3fde tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.731615 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fc19a7f9-fa0d-44a1-b68e-a7d8206d3fde tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.869090 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-62e1bd26-2881-4921-8e6e-f1db4d9b0785 req-05d6b6c4-6aa0-4991-b3ef-507a0762f37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a2ed3f-3b98-4052-9f7f-934179a73cbe", "name": "network-vif-plugged", "status": "completed", "tag": "2e260ecb-d92a-4742-8e06-f69dee207767"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:24.879194 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-62e1bd26-2881-4921-8e6e-f1db4d9b0785 req-05d6b6c4-6aa0-4991-b3ef-507a0762f37d service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.879571 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-62e1bd26-2881-4921-8e6e-f1db4d9b0785 req-05d6b6c4-6aa0-4991-b3ef-507a0762f37d service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.891993 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-62e1bd26-2881-4921-8e6e-f1db4d9b0785 req-05d6b6c4-6aa0-4991-b3ef-507a0762f37d service nova] Creating event network-vif-plugged:2e260ecb-d92a-4742-8e06-f69dee207767 for instance 16a2ed3f-3b98-4052-9f7f-934179a73cbe on hv-cinder-84159 May 13 13:29:24.897433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-62e1bd26-2881-4921-8e6e-f1db4d9b0785 req-05d6b6c4-6aa0-4991-b3ef-507a0762f37d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033673 May 13 13:29:24.898155 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 285/597] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:24.906312 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0cb61a1b-5f91-4678-892f-3c13ebfa65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:24.906961 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0cb61a1b-5f91-4678-892f-3c13ebfa65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:24.914949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0cb61a1b-5f91-4678-892f-3c13ebfa65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.916599 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0cb61a1b-5f91-4678-892f-3c13ebfa65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.916599 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0cb61a1b-5f91-4678-892f-3c13ebfa65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.917205 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0cb61a1b-5f91-4678-892f-3c13ebfa65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.954799 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0cb61a1b-5f91-4678-892f-3c13ebfa65ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments/fc1dc3c8-3d1a-4b45-982f-edb484911545" status: 200 len: 194 microversion: 2.20 time: 0.054050 May 13 13:29:24.955444 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 286/598] 10.222.0.25 () {60 vars in 1453 bytes} [Fri May 13 13:29:24 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments/fc1dc3c8-3d1a-4b45-982f-edb484911545 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:29:24.957223 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fc19a7f9-fa0d-44a1-b68e-a7d8206d3fde tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:24.960553 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2a321397-48a8-4cbe-9432-963141c7e536 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:24.962965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2a321397-48a8-4cbe-9432-963141c7e536 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:24.971701 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2a321397-48a8-4cbe-9432-963141c7e536 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.979694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2a321397-48a8-4cbe-9432-963141c7e536 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.979694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2a321397-48a8-4cbe-9432-963141c7e536 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:24.979694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2a321397-48a8-4cbe-9432-963141c7e536 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:24.991867 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fc19a7f9-fa0d-44a1-b68e-a7d8206d3fde tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1319 microversion: 2.1 time: 0.286734 May 13 13:29:24.992614 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 313/599] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:24 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:25.046985 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0411df27-8816-42ee-956d-d0d22e7082c3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:25.047680 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0411df27-8816-42ee-956d-d0d22e7082c3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:25.058518 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0411df27-8816-42ee-956d-d0d22e7082c3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:25.059000 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0411df27-8816-42ee-956d-d0d22e7082c3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:25.059799 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0411df27-8816-42ee-956d-d0d22e7082c3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:25.060250 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0411df27-8816-42ee-956d-d0d22e7082c3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:25.126147 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2a321397-48a8-4cbe-9432-963141c7e536 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:25.134344 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2a321397-48a8-4cbe-9432-963141c7e536 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.177708 May 13 13:29:25.135205 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 287/600] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:24 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:25.199406 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3f35ba1a-ec26-4c17-a5ab-68d3c91af3ca tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:25.200110 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3f35ba1a-ec26-4c17-a5ab-68d3c91af3ca tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:25.200757 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-0411df27-8816-42ee-956d-d0d22e7082c3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lazy-loading 'services' on Instance uuid 89412841-b653-4a80-8cde-0c7a264a9c4c {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:29:25.206418 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3f35ba1a-ec26-4c17-a5ab-68d3c91af3ca tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:25.206870 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3f35ba1a-ec26-4c17-a5ab-68d3c91af3ca tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:25.207642 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3f35ba1a-ec26-4c17-a5ab-68d3c91af3ca tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:25.208078 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3f35ba1a-ec26-4c17-a5ab-68d3c91af3ca tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:25.375809 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3f35ba1a-ec26-4c17-a5ab-68d3c91af3ca tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:25.384307 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3f35ba1a-ec26-4c17-a5ab-68d3c91af3ca tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.187569 May 13 13:29:25.384917 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 288/601] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:25 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:25.585722 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0411df27-8816-42ee-956d-d0d22e7082c3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "DELETE /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments/fc1dc3c8-3d1a-4b45-982f-edb484911545" status: 202 len: 0 microversion: 2.20 time: 0.544268 May 13 13:29:25.586387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 314/602] 10.222.0.25 () {60 vars in 1456 bytes} [Fri May 13 13:29:25 2022] DELETE /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments/fc1dc3c8-3d1a-4b45-982f-edb484911545 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 13 13:29:25.595680 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3de696b1-c300-40a3-a655-b3f64541cd19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:25.596739 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3de696b1-c300-40a3-a655-b3f64541cd19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:25.607104 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3de696b1-c300-40a3-a655-b3f64541cd19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:25.607559 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3de696b1-c300-40a3-a655-b3f64541cd19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:25.608350 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3de696b1-c300-40a3-a655-b3f64541cd19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:25.608794 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3de696b1-c300-40a3-a655-b3f64541cd19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:25.641369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3de696b1-c300-40a3-a655-b3f64541cd19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050070 May 13 13:29:25.642845 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 289/603] 10.222.0.25 () {60 vars in 1342 bytes} [Fri May 13 13:29:25 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:29:26.010462 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cb13f2c7-8a41-4935-9c1b-a94c930f562f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:26.011173 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-cb13f2c7-8a41-4935-9c1b-a94c930f562f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:26.017618 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb13f2c7-8a41-4935-9c1b-a94c930f562f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.018105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb13f2c7-8a41-4935-9c1b-a94c930f562f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.018895 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb13f2c7-8a41-4935-9c1b-a94c930f562f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.019340 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-cb13f2c7-8a41-4935-9c1b-a94c930f562f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.151884 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-bd0487fb-66f8-4494-8388-61e2a1636828 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:26.152377 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-cb13f2c7-8a41-4935-9c1b-a94c930f562f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:26.152514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-bd0487fb-66f8-4494-8388-61e2a1636828 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:26.159023 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bd0487fb-66f8-4494-8388-61e2a1636828 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.159480 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bd0487fb-66f8-4494-8388-61e2a1636828 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.160162 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cb13f2c7-8a41-4935-9c1b-a94c930f562f tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1319 microversion: 2.1 time: 0.154162 May 13 13:29:26.160290 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bd0487fb-66f8-4494-8388-61e2a1636828 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.160686 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bd0487fb-66f8-4494-8388-61e2a1636828 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.160805 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 315/604] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:26 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:26.285673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bd0487fb-66f8-4494-8388-61e2a1636828 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:26.299520 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-bd0487fb-66f8-4494-8388-61e2a1636828 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.151576 May 13 13:29:26.300111 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 290/605] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:26 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:26.402626 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4537ee74-2789-4a03-96a8-83c71e733d7d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:26.403306 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4537ee74-2789-4a03-96a8-83c71e733d7d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:26.409144 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4537ee74-2789-4a03-96a8-83c71e733d7d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.409602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4537ee74-2789-4a03-96a8-83c71e733d7d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.410403 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4537ee74-2789-4a03-96a8-83c71e733d7d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.410846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4537ee74-2789-4a03-96a8-83c71e733d7d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.540969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4537ee74-2789-4a03-96a8-83c71e733d7d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:26.548811 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4537ee74-2789-4a03-96a8-83c71e733d7d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.150120 May 13 13:29:26.549378 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 316/606] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:26 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:26.654033 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a865b087-a8ad-4da8-af12-b2d5d3c00f11 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:26.655565 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a865b087-a8ad-4da8-af12-b2d5d3c00f11 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:26.661837 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a865b087-a8ad-4da8-af12-b2d5d3c00f11 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.662321 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a865b087-a8ad-4da8-af12-b2d5d3c00f11 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.663100 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a865b087-a8ad-4da8-af12-b2d5d3c00f11 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:26.663543 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a865b087-a8ad-4da8-af12-b2d5d3c00f11 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:26.691922 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a865b087-a8ad-4da8-af12-b2d5d3c00f11 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041938 May 13 13:29:26.692465 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 291/607] 10.222.0.25 () {60 vars in 1342 bytes} [Fri May 13 13:29:26 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:29:27.177243 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-90ed790c-a1db-4ad9-9616-53a0928121a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:27.177872 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-90ed790c-a1db-4ad9-9616-53a0928121a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:27.183834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-90ed790c-a1db-4ad9-9616-53a0928121a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.184289 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-90ed790c-a1db-4ad9-9616-53a0928121a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.185053 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-90ed790c-a1db-4ad9-9616-53a0928121a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.185493 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-90ed790c-a1db-4ad9-9616-53a0928121a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.312614 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-90ed790c-a1db-4ad9-9616-53a0928121a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:27.319969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-90ed790c-a1db-4ad9-9616-53a0928121a3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1319 microversion: 2.1 time: 0.146502 May 13 13:29:27.320526 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 317/608] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:27 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:27.323347 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ae317788-c314-402b-ae0f-960741f85eaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:27.323958 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ae317788-c314-402b-ae0f-960741f85eaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:27.330251 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ae317788-c314-402b-ae0f-960741f85eaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.330712 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ae317788-c314-402b-ae0f-960741f85eaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.331490 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ae317788-c314-402b-ae0f-960741f85eaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.331933 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ae317788-c314-402b-ae0f-960741f85eaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.468882 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ae317788-c314-402b-ae0f-960741f85eaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:27.476734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ae317788-c314-402b-ae0f-960741f85eaa tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.163901 May 13 13:29:27.477295 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 292/609] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:27 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:27.565623 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9fb0b077-0c78-461f-82b3-c28e6d236fa9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:27.566277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9fb0b077-0c78-461f-82b3-c28e6d236fa9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:27.572096 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9fb0b077-0c78-461f-82b3-c28e6d236fa9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.572550 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9fb0b077-0c78-461f-82b3-c28e6d236fa9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.573315 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9fb0b077-0c78-461f-82b3-c28e6d236fa9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.573756 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9fb0b077-0c78-461f-82b3-c28e6d236fa9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.704057 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0d354451-bc6f-4845-ba92-c685435cc86f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:27.705116 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0d354451-bc6f-4845-ba92-c685435cc86f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:27.708575 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9fb0b077-0c78-461f-82b3-c28e6d236fa9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:27.711858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0d354451-bc6f-4845-ba92-c685435cc86f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.712316 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0d354451-bc6f-4845-ba92-c685435cc86f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.713117 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0d354451-bc6f-4845-ba92-c685435cc86f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:27.713560 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0d354451-bc6f-4845-ba92-c685435cc86f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:27.720129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9fb0b077-0c78-461f-82b3-c28e6d236fa9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.158730 May 13 13:29:27.720713 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 318/610] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:27 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:27.743709 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0d354451-bc6f-4845-ba92-c685435cc86f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043987 May 13 13:29:27.744264 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 293/611] 10.222.0.25 () {60 vars in 1342 bytes} [Fri May 13 13:29:27 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:29:28.337265 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-713a263c-437b-4f19-85d5-8cd5aa8782aa tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:28.337911 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-713a263c-437b-4f19-85d5-8cd5aa8782aa tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:28.343769 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-713a263c-437b-4f19-85d5-8cd5aa8782aa tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:28.344248 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-713a263c-437b-4f19-85d5-8cd5aa8782aa tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:28.345014 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-713a263c-437b-4f19-85d5-8cd5aa8782aa tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:28.345450 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-713a263c-437b-4f19-85d5-8cd5aa8782aa tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:28.470008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-713a263c-437b-4f19-85d5-8cd5aa8782aa tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:28.477298 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-713a263c-437b-4f19-85d5-8cd5aa8782aa tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1509 microversion: 2.1 time: 0.143825 May 13 13:29:28.477890 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 319/612] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:28 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1509 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:28.493203 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-fa9b3f2f-fa50-4217-8b5a-43282cf42046 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:28.493685 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-35db0f6b-7f84-458e-be89-3e68db0f38c3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d57ae1b3-2725-43f6-9f74-567e518ae3d2", "device": "/dev/sdb"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:28.493943 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-fa9b3f2f-fa50-4217-8b5a-43282cf42046 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:28.496039 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-35db0f6b-7f84-458e-be89-3e68db0f38c3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:28.500724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa9b3f2f-fa50-4217-8b5a-43282cf42046 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:28.501176 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa9b3f2f-fa50-4217-8b5a-43282cf42046 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:28.501984 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa9b3f2f-fa50-4217-8b5a-43282cf42046 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:28.502419 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa9b3f2f-fa50-4217-8b5a-43282cf42046 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:28.502758 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-35db0f6b-7f84-458e-be89-3e68db0f38c3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:28.503215 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-35db0f6b-7f84-458e-be89-3e68db0f38c3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:28.503993 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-35db0f6b-7f84-458e-be89-3e68db0f38c3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:28.504430 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-35db0f6b-7f84-458e-be89-3e68db0f38c3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:28.632447 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-fa9b3f2f-fa50-4217-8b5a-43282cf42046 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:28.640231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-fa9b3f2f-fa50-4217-8b5a-43282cf42046 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.150890 May 13 13:29:28.640800 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 294/613] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:28 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:28.737332 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1be1d39b-9f13-43ec-8d1b-61c1d025987a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:28.737994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1be1d39b-9f13-43ec-8d1b-61c1d025987a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:28.744457 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1be1d39b-9f13-43ec-8d1b-61c1d025987a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:28.745351 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1be1d39b-9f13-43ec-8d1b-61c1d025987a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:28.745730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1be1d39b-9f13-43ec-8d1b-61c1d025987a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:28.746236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1be1d39b-9f13-43ec-8d1b-61c1d025987a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:28.879691 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1be1d39b-9f13-43ec-8d1b-61c1d025987a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:28.887204 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1be1d39b-9f13-43ec-8d1b-61c1d025987a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.154530 May 13 13:29:28.887778 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 295/614] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:28 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:28.892317 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3f6e1856-e80a-447b-95f3-9ae38f2c31dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:28.893225 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3f6e1856-e80a-447b-95f3-9ae38f2c31dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:28.898774 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3f6e1856-e80a-447b-95f3-9ae38f2c31dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:28.899804 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3f6e1856-e80a-447b-95f3-9ae38f2c31dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:28.900019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3f6e1856-e80a-447b-95f3-9ae38f2c31dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:28.900460 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3f6e1856-e80a-447b-95f3-9ae38f2c31dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:28.932093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3f6e1856-e80a-447b-95f3-9ae38f2c31dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043230 May 13 13:29:28.934453 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 296/615] 10.222.0.25 () {60 vars in 1342 bytes} [Fri May 13 13:29:28 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:29:29.657071 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-892355bb-479c-43bc-99e0-7ac04c93af3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:29.657721 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-892355bb-479c-43bc-99e0-7ac04c93af3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:29.663578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-892355bb-479c-43bc-99e0-7ac04c93af3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:29.664033 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-892355bb-479c-43bc-99e0-7ac04c93af3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:29.664796 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-892355bb-479c-43bc-99e0-7ac04c93af3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:29.665229 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-892355bb-479c-43bc-99e0-7ac04c93af3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:29.775523 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-35db0f6b-7f84-458e-be89-3e68db0f38c3 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "POST /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.285285 May 13 13:29:29.776483 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 320/616] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:29:28 2022] POST /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe/os-volume_attachments => generated 194 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:29:29.800817 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-892355bb-479c-43bc-99e0-7ac04c93af3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:29.809057 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-892355bb-479c-43bc-99e0-7ac04c93af3c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.155778 May 13 13:29:29.809849 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 297/617] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:29 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:29.903617 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e4f62b2d-1dc1-4b64-831c-7a58e9cdfba6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:29.904318 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e4f62b2d-1dc1-4b64-831c-7a58e9cdfba6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:29.911188 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e4f62b2d-1dc1-4b64-831c-7a58e9cdfba6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:29.911648 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e4f62b2d-1dc1-4b64-831c-7a58e9cdfba6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:29.912425 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e4f62b2d-1dc1-4b64-831c-7a58e9cdfba6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:29.912875 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e4f62b2d-1dc1-4b64-831c-7a58e9cdfba6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:29.944543 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-45cb27b2-dc7f-4af2-8f38-c1026ba98b36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:29.945476 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-45cb27b2-dc7f-4af2-8f38-c1026ba98b36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:29.951500 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-45cb27b2-dc7f-4af2-8f38-c1026ba98b36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:29.951947 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-45cb27b2-dc7f-4af2-8f38-c1026ba98b36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:29.957916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-45cb27b2-dc7f-4af2-8f38-c1026ba98b36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:29.957916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-45cb27b2-dc7f-4af2-8f38-c1026ba98b36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:29.983813 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-45cb27b2-dc7f-4af2-8f38-c1026ba98b36 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043155 May 13 13:29:29.984627 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 298/618] 10.222.0.25 () {60 vars in 1342 bytes} [Fri May 13 13:29:29 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:30.045502 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-dc73a4d7-1883-4610-907e-61cc5785b4a1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:30.046678 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-dc73a4d7-1883-4610-907e-61cc5785b4a1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:30.052671 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dc73a4d7-1883-4610-907e-61cc5785b4a1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:30.053127 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dc73a4d7-1883-4610-907e-61cc5785b4a1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:30.053242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e4f62b2d-1dc1-4b64-831c-7a58e9cdfba6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:30.054027 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dc73a4d7-1883-4610-907e-61cc5785b4a1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:30.054469 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dc73a4d7-1883-4610-907e-61cc5785b4a1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:30.061174 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e4f62b2d-1dc1-4b64-831c-7a58e9cdfba6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.161882 May 13 13:29:30.062869 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 321/619] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:29 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:30.087296 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-dc73a4d7-1883-4610-907e-61cc5785b4a1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Going to try to terminate instance {{(pid=117602) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:29:30.369016 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-dc73a4d7-1883-4610-907e-61cc5785b4a1 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "DELETE /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 204 len: 0 microversion: 2.20 time: 0.327067 May 13 13:29:30.369598 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 299/620] 10.222.0.25 () {60 vars in 1279 bytes} [Fri May 13 13:29:30 2022] DELETE /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 13:29:30.378418 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b89d7af6-0284-4624-b4cd-a07efa4b7ba2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:30.379113 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b89d7af6-0284-4624-b4cd-a07efa4b7ba2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:30.385506 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b89d7af6-0284-4624-b4cd-a07efa4b7ba2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:30.385995 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b89d7af6-0284-4624-b4cd-a07efa4b7ba2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:30.386763 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b89d7af6-0284-4624-b4cd-a07efa4b7ba2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:30.387206 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b89d7af6-0284-4624-b4cd-a07efa4b7ba2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:30.519478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b89d7af6-0284-4624-b4cd-a07efa4b7ba2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:30.527479 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b89d7af6-0284-4624-b4cd-a07efa4b7ba2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:30.528960 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b89d7af6-0284-4624-b4cd-a07efa4b7ba2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:30.531585 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b89d7af6-0284-4624-b4cd-a07efa4b7ba2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.156173 May 13 13:29:30.531585 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 322/621] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:30 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:30.828410 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c29dda14-66ea-422d-b5ef-01a79f0cfcd6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:30.829093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c29dda14-66ea-422d-b5ef-01a79f0cfcd6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:30.835985 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c29dda14-66ea-422d-b5ef-01a79f0cfcd6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:30.836451 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c29dda14-66ea-422d-b5ef-01a79f0cfcd6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:30.837319 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c29dda14-66ea-422d-b5ef-01a79f0cfcd6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:30.837661 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c29dda14-66ea-422d-b5ef-01a79f0cfcd6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:30.968298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c29dda14-66ea-422d-b5ef-01a79f0cfcd6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:30.976176 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c29dda14-66ea-422d-b5ef-01a79f0cfcd6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1735 microversion: 2.1 time: 0.152946 May 13 13:29:30.976770 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 300/622] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:30 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:31.079650 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-dbe3e228-2dd8-420f-9c0a-19a439ff82e2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:31.080175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-dbe3e228-2dd8-420f-9c0a-19a439ff82e2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:31.086152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dbe3e228-2dd8-420f-9c0a-19a439ff82e2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:31.086639 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dbe3e228-2dd8-420f-9c0a-19a439ff82e2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:31.087524 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dbe3e228-2dd8-420f-9c0a-19a439ff82e2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:31.087970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-dbe3e228-2dd8-420f-9c0a-19a439ff82e2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:31.224338 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-dbe3e228-2dd8-420f-9c0a-19a439ff82e2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:31.231401 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-dbe3e228-2dd8-420f-9c0a-19a439ff82e2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.156542 May 13 13:29:31.231950 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 323/623] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:31 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:31.549607 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e4c84a9b-2512-4b29-b151-bf5274b5d9ac tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:31.550248 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e4c84a9b-2512-4b29-b151-bf5274b5d9ac tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:31.556502 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e4c84a9b-2512-4b29-b151-bf5274b5d9ac tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:31.557013 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e4c84a9b-2512-4b29-b151-bf5274b5d9ac tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:31.557873 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e4c84a9b-2512-4b29-b151-bf5274b5d9ac tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:31.558318 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e4c84a9b-2512-4b29-b151-bf5274b5d9ac tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:31.685732 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e4c84a9b-2512-4b29-b151-bf5274b5d9ac tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:31.698148 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e4c84a9b-2512-4b29-b151-bf5274b5d9ac tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:31.699672 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e4c84a9b-2512-4b29-b151-bf5274b5d9ac tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:31.703911 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e4c84a9b-2512-4b29-b151-bf5274b5d9ac tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.155948 May 13 13:29:31.703911 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 301/624] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:31 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:31.992297 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1d2e1725-1902-4faa-8b32-59db2ef20048 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:31.992964 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1d2e1725-1902-4faa-8b32-59db2ef20048 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:31.999840 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1d2e1725-1902-4faa-8b32-59db2ef20048 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.000296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1d2e1725-1902-4faa-8b32-59db2ef20048 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.001072 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1d2e1725-1902-4faa-8b32-59db2ef20048 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.001517 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1d2e1725-1902-4faa-8b32-59db2ef20048 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.129189 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1d2e1725-1902-4faa-8b32-59db2ef20048 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:32.137374 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1d2e1725-1902-4faa-8b32-59db2ef20048 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1715 microversion: 2.1 time: 0.148798 May 13 13:29:32.138223 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 324/625] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:31 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1715 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:32.238010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-499ef21e-39f4-4676-90db-5733a52af46f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:32.238530 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-499ef21e-39f4-4676-90db-5733a52af46f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:32.244888 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-499ef21e-39f4-4676-90db-5733a52af46f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.245339 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-499ef21e-39f4-4676-90db-5733a52af46f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.246130 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-499ef21e-39f4-4676-90db-5733a52af46f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.246568 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-499ef21e-39f4-4676-90db-5733a52af46f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.247752 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4c1b695f-4869-4176-8145-666d06a0a537 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:32.248394 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4c1b695f-4869-4176-8145-666d06a0a537 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:32.254800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c1b695f-4869-4176-8145-666d06a0a537 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.255254 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c1b695f-4869-4176-8145-666d06a0a537 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.256031 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c1b695f-4869-4176-8145-666d06a0a537 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.256478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c1b695f-4869-4176-8145-666d06a0a537 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.327009 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-499ef21e-39f4-4676-90db-5733a52af46f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] HTTP exception thrown: Cannot 'detach_volume' instance c8063f90-dde5-4697-b772-2d63abfae0ec while it is in vm_state rescued May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-499ef21e-39f4-4676-90db-5733a52af46f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Request method failure captured: May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: DELETE /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments/8105072d-3542-45d8-a219-b8b413d7e40a HTTP/1.1 May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflxCd_EoZAFYbTN-djoZynqAsA3N46ltWXN6ElWTHOeJzEEmWdor9xpEb-TN-9UOIjpjSWAAhgMGge4_A1Ww39JKwMQCj0YClHxuL6gKubHiyHfreieaD5jWE6gpoVXXhVTxV1jR6o9ep4G9hWBPrRMtkJorZmtfTBTb1K8oDMtHNwA May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: e25902914d244bfeaa038f24838c28ca May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:29:32.328824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:29:32.330436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e25902914d244bfeaa038f24838c28ca", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:29:32.330436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:29:32.330436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: e25902914d244bfeaa038f24838c28ca May 13 13:29:32.330436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:29:32.330436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-ServerRescueNegativeTestJSON-1596782097-project May 13 13:29:32.330436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:29:32.330436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:29:32.330436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: f56c908ada31445e85ec1dfee8e2ebdb May 13 13:29:32.330436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1596782097-project May 13 13:29:32.330436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:29:32.330436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Cannot 'detach_volume' instance c8063f90-dde5-4697-b772-2d63abfae0ec while it is in vm_state rescued May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'server_id': 'c8063f90-dde5-4697-b772-2d63abfae0ec', 'id': '8105072d-3542-45d8-a219-b8b413d7e40a'} May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c8063f90-dde5-4697-b772-2d63abfae0ec in vm_state rescued. Cannot detach_volume while the instance is in this state. May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:29:32.334462 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c8063f90-dde5-4697-b772-2d63abfae0ec while it is in vm_state rescued May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c8063f90-dde5-4697-b772-2d63abfae0ec while it is in vm_state rescued May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:29:32.335973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-499ef21e-39f4-4676-90db-5733a52af46f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Returning 409 to user: Cannot 'detach_volume' instance c8063f90-dde5-4697-b772-2d63abfae0ec while it is in vm_state rescued {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:29:32.337142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-499ef21e-39f4-4676-90db-5733a52af46f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments/8105072d-3542-45d8-a219-b8b413d7e40a" status: 409 len: 152 microversion: 2.1 time: 0.096881 May 13 13:29:32.337142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 302/626] 10.222.0.25 () {58 vars in 1415 bytes} [Fri May 13 13:29:32 2022] DELETE /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments/8105072d-3542-45d8-a219-b8b413d7e40a => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 13:29:32.340529 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-dba1c10a-31eb-4961-9b09-7e76c873f7e2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:32.340529 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-dba1c10a-31eb-4961-9b09-7e76c873f7e2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:32.346733 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dba1c10a-31eb-4961-9b09-7e76c873f7e2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.347188 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dba1c10a-31eb-4961-9b09-7e76c873f7e2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.348080 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dba1c10a-31eb-4961-9b09-7e76c873f7e2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.348504 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dba1c10a-31eb-4961-9b09-7e76c873f7e2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.392264 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4c1b695f-4869-4176-8145-666d06a0a537 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:32.399512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4c1b695f-4869-4176-8145-666d06a0a537 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.155576 May 13 13:29:32.400101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 325/627] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:32 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:32.553553 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-dba1c10a-31eb-4961-9b09-7e76c873f7e2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "POST /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/action" status: 202 len: 0 microversion: 2.1 time: 0.217648 May 13 13:29:32.554369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 303/628] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:29:32 2022] POST /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:29:32.562310 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4a72cbc9-976b-40eb-991e-328c1d9c800f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:32.562929 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4a72cbc9-976b-40eb-991e-328c1d9c800f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:32.568880 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a72cbc9-976b-40eb-991e-328c1d9c800f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.569341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a72cbc9-976b-40eb-991e-328c1d9c800f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.570155 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a72cbc9-976b-40eb-991e-328c1d9c800f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.570602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a72cbc9-976b-40eb-991e-328c1d9c800f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.695615 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4a72cbc9-976b-40eb-991e-328c1d9c800f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:32.703649 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4a72cbc9-976b-40eb-991e-328c1d9c800f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1723 microversion: 2.1 time: 0.145098 May 13 13:29:32.704217 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 326/629] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:32 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:32.719830 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b5e7411c-2b3c-44f9-8d9b-88facaffcc4a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:32.720520 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b5e7411c-2b3c-44f9-8d9b-88facaffcc4a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:32.726605 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b5e7411c-2b3c-44f9-8d9b-88facaffcc4a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.727056 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b5e7411c-2b3c-44f9-8d9b-88facaffcc4a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.727816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b5e7411c-2b3c-44f9-8d9b-88facaffcc4a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:32.728248 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b5e7411c-2b3c-44f9-8d9b-88facaffcc4a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:32.878596 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b5e7411c-2b3c-44f9-8d9b-88facaffcc4a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:32.886855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b5e7411c-2b3c-44f9-8d9b-88facaffcc4a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:32.888390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b5e7411c-2b3c-44f9-8d9b-88facaffcc4a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:32.890101 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b5e7411c-2b3c-44f9-8d9b-88facaffcc4a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.174510 May 13 13:29:32.890678 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 304/630] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:32 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:33.417065 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a9f7611f-be72-44de-be03-4557de38f09b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:33.417680 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a9f7611f-be72-44de-be03-4557de38f09b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:33.424107 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a9f7611f-be72-44de-be03-4557de38f09b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:33.424556 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a9f7611f-be72-44de-be03-4557de38f09b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:33.425318 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a9f7611f-be72-44de-be03-4557de38f09b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:33.425756 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a9f7611f-be72-44de-be03-4557de38f09b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:33.554943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a9f7611f-be72-44de-be03-4557de38f09b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:33.562580 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a9f7611f-be72-44de-be03-4557de38f09b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.149841 May 13 13:29:33.563148 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 327/631] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:33 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:33.721284 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3b7394a7-fac4-42b7-94fb-75c81808c956 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:33.721922 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3b7394a7-fac4-42b7-94fb-75c81808c956 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:33.728306 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3b7394a7-fac4-42b7-94fb-75c81808c956 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:33.728754 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3b7394a7-fac4-42b7-94fb-75c81808c956 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:33.729521 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3b7394a7-fac4-42b7-94fb-75c81808c956 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:33.729994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3b7394a7-fac4-42b7-94fb-75c81808c956 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:33.857235 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3b7394a7-fac4-42b7-94fb-75c81808c956 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:33.864999 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3b7394a7-fac4-42b7-94fb-75c81808c956 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1723 microversion: 2.1 time: 0.148072 May 13 13:29:33.865584 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 305/632] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:33 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:33.908999 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a752b8c6-4b64-4d0b-a8da-b5eb49c6bc0c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:33.909641 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a752b8c6-4b64-4d0b-a8da-b5eb49c6bc0c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:33.915558 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a752b8c6-4b64-4d0b-a8da-b5eb49c6bc0c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:33.916012 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a752b8c6-4b64-4d0b-a8da-b5eb49c6bc0c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:33.916818 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a752b8c6-4b64-4d0b-a8da-b5eb49c6bc0c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:33.917261 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a752b8c6-4b64-4d0b-a8da-b5eb49c6bc0c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:34.075657 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a752b8c6-4b64-4d0b-a8da-b5eb49c6bc0c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:34.084206 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a752b8c6-4b64-4d0b-a8da-b5eb49c6bc0c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:34.085707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a752b8c6-4b64-4d0b-a8da-b5eb49c6bc0c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:34.086893 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a752b8c6-4b64-4d0b-a8da-b5eb49c6bc0c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.182332 May 13 13:29:34.087452 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 328/633] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:33 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:34.579112 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0ec1beae-25a0-4654-97c3-9fd9b4c6f772 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:34.579724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0ec1beae-25a0-4654-97c3-9fd9b4c6f772 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:34.585658 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0ec1beae-25a0-4654-97c3-9fd9b4c6f772 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:34.586171 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0ec1beae-25a0-4654-97c3-9fd9b4c6f772 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:34.586956 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0ec1beae-25a0-4654-97c3-9fd9b4c6f772 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:34.587381 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0ec1beae-25a0-4654-97c3-9fd9b4c6f772 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:34.872146 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0ec1beae-25a0-4654-97c3-9fd9b4c6f772 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:34.879536 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0ec1beae-25a0-4654-97c3-9fd9b4c6f772 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.304419 May 13 13:29:34.880079 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 306/634] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:34 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:34.883611 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-738293ce-6db0-4e2e-ac28-7495c7476aca tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:34.884346 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-738293ce-6db0-4e2e-ac28-7495c7476aca tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:34.890789 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-738293ce-6db0-4e2e-ac28-7495c7476aca tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:34.891331 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-738293ce-6db0-4e2e-ac28-7495c7476aca tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:34.892219 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-738293ce-6db0-4e2e-ac28-7495c7476aca tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:34.892732 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-738293ce-6db0-4e2e-ac28-7495c7476aca tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:35.023927 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-738293ce-6db0-4e2e-ac28-7495c7476aca tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:35.032401 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-738293ce-6db0-4e2e-ac28-7495c7476aca tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1723 microversion: 2.1 time: 0.152992 May 13 13:29:35.070167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 329/635] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:34 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:35.104582 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c256db96-37e6-4e99-abeb-39b277eb8fda tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:35.125306 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c256db96-37e6-4e99-abeb-39b277eb8fda tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:35.125306 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c256db96-37e6-4e99-abeb-39b277eb8fda tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:35.125306 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c256db96-37e6-4e99-abeb-39b277eb8fda tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:35.125306 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c256db96-37e6-4e99-abeb-39b277eb8fda tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:35.125776 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c256db96-37e6-4e99-abeb-39b277eb8fda tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:35.563960 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c256db96-37e6-4e99-abeb-39b277eb8fda tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:35.571908 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c256db96-37e6-4e99-abeb-39b277eb8fda tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:35.573493 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c256db96-37e6-4e99-abeb-39b277eb8fda tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:35.574735 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c256db96-37e6-4e99-abeb-39b277eb8fda tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1723 microversion: 2.20 time: 0.474235 May 13 13:29:35.575374 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 307/636] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:35 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1723 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:29:35.784093 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-aea96c50-8d1e-44fa-9de7-b5f02c627848 req-a32e95b9-5654-4a6a-8734-d6ef6cd85db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89412841-b653-4a80-8cde-0c7a264a9c4c", "name": "network-vif-deleted", "tag": "1a4cef43-4ad0-41f0-9857-11ea57340642"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:35.792222 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-aea96c50-8d1e-44fa-9de7-b5f02c627848 req-a32e95b9-5654-4a6a-8734-d6ef6cd85db7 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:35.792664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-aea96c50-8d1e-44fa-9de7-b5f02c627848 req-a32e95b9-5654-4a6a-8734-d6ef6cd85db7 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:35.803705 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-aea96c50-8d1e-44fa-9de7-b5f02c627848 req-a32e95b9-5654-4a6a-8734-d6ef6cd85db7 service nova] Creating event network-vif-deleted:1a4cef43-4ad0-41f0-9857-11ea57340642 for instance 89412841-b653-4a80-8cde-0c7a264a9c4c on hv-cinder-84159 May 13 13:29:35.809843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-aea96c50-8d1e-44fa-9de7-b5f02c627848 req-a32e95b9-5654-4a6a-8734-d6ef6cd85db7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029344 May 13 13:29:35.810439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 330/637] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:35.895566 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c3ec45ac-aab4-4704-9215-8fb2dbaac0ec tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:35.897055 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c3ec45ac-aab4-4704-9215-8fb2dbaac0ec tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:35.903950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c3ec45ac-aab4-4704-9215-8fb2dbaac0ec tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:35.904396 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c3ec45ac-aab4-4704-9215-8fb2dbaac0ec tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:35.905171 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c3ec45ac-aab4-4704-9215-8fb2dbaac0ec tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:35.905606 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c3ec45ac-aab4-4704-9215-8fb2dbaac0ec tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:36.042599 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c3ec45ac-aab4-4704-9215-8fb2dbaac0ec tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:36.051343 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-98bcac22-a470-42e0-9631-79e56f5a5a8c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:36.052050 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c3ec45ac-aab4-4704-9215-8fb2dbaac0ec tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.160328 May 13 13:29:36.052928 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-98bcac22-a470-42e0-9631-79e56f5a5a8c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:36.062985 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 308/638] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:35 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:36.067359 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-98bcac22-a470-42e0-9631-79e56f5a5a8c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:36.067832 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-98bcac22-a470-42e0-9631-79e56f5a5a8c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:36.068621 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-98bcac22-a470-42e0-9631-79e56f5a5a8c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:36.069296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-98bcac22-a470-42e0-9631-79e56f5a5a8c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:36.214784 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-98bcac22-a470-42e0-9631-79e56f5a5a8c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:36.223052 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-98bcac22-a470-42e0-9631-79e56f5a5a8c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1723 microversion: 2.1 time: 0.177241 May 13 13:29:36.223626 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 331/639] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:36 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:36.593941 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e3fb4cfe-26bf-4223-b51f-10dcebc749c5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:36.594559 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e3fb4cfe-26bf-4223-b51f-10dcebc749c5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:36.600717 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e3fb4cfe-26bf-4223-b51f-10dcebc749c5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:36.601166 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e3fb4cfe-26bf-4223-b51f-10dcebc749c5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:36.602019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e3fb4cfe-26bf-4223-b51f-10dcebc749c5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:36.602458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e3fb4cfe-26bf-4223-b51f-10dcebc749c5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:36.667887 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e3fb4cfe-26bf-4223-b51f-10dcebc749c5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:36.678971 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e3fb4cfe-26bf-4223-b51f-10dcebc749c5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:36.680492 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e3fb4cfe-26bf-4223-b51f-10dcebc749c5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:36.681657 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e3fb4cfe-26bf-4223-b51f-10dcebc749c5 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1366 microversion: 2.20 time: 0.091676 May 13 13:29:36.693800 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 309/640] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:36 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:36.855700 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-05ff0970-fdd6-4c14-b7fc-e75db32202b2 req-19af1505-6642-4288-b1eb-96d60161d34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c", "name": "network-vif-plugged", "status": "completed", "tag": "d1cd2559-b1b4-466c-9ab5-45773dffdb54"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:36.864670 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-05ff0970-fdd6-4c14-b7fc-e75db32202b2 req-19af1505-6642-4288-b1eb-96d60161d34a service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:36.868312 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-05ff0970-fdd6-4c14-b7fc-e75db32202b2 req-19af1505-6642-4288-b1eb-96d60161d34a service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:36.877696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-05ff0970-fdd6-4c14-b7fc-e75db32202b2 req-19af1505-6642-4288-b1eb-96d60161d34a service nova] Creating event network-vif-plugged:d1cd2559-b1b4-466c-9ab5-45773dffdb54 for instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c on hv-cinder-84159 May 13 13:29:36.882665 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-05ff0970-fdd6-4c14-b7fc-e75db32202b2 req-19af1505-6642-4288-b1eb-96d60161d34a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030799 May 13 13:29:36.883254 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 332/641] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:29:37.068829 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c2acde8d-a0d3-4e05-8f23-8e1252c4a723 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:37.069448 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c2acde8d-a0d3-4e05-8f23-8e1252c4a723 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:37.075923 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2acde8d-a0d3-4e05-8f23-8e1252c4a723 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:37.076380 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2acde8d-a0d3-4e05-8f23-8e1252c4a723 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:37.077173 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2acde8d-a0d3-4e05-8f23-8e1252c4a723 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:37.077614 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2acde8d-a0d3-4e05-8f23-8e1252c4a723 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:37.225678 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c2acde8d-a0d3-4e05-8f23-8e1252c4a723 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:37.232876 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c2acde8d-a0d3-4e05-8f23-8e1252c4a723 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.168088 May 13 13:29:37.233480 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 310/642] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:37 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:37.248627 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9b1c4a3c-7244-4ed5-856c-1ed9c12f2b11 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:37.249972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9b1c4a3c-7244-4ed5-856c-1ed9c12f2b11 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:37.257405 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a3c-7244-4ed5-856c-1ed9c12f2b11 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:37.258141 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a3c-7244-4ed5-856c-1ed9c12f2b11 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:37.259225 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a3c-7244-4ed5-856c-1ed9c12f2b11 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:37.259826 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9b1c4a3c-7244-4ed5-856c-1ed9c12f2b11 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:37.404054 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9b1c4a3c-7244-4ed5-856c-1ed9c12f2b11 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:37.412066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9b1c4a3c-7244-4ed5-856c-1ed9c12f2b11 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1723 microversion: 2.1 time: 0.167850 May 13 13:29:37.418539 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 333/643] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:37 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:37.700111 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:37.700649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:37.707095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:37.707567 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:37.708337 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:37.708872 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:37.739872 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:37.740330 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:37.740781 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lazy-loading 'fault' on Instance uuid 89412841-b653-4a80-8cde-0c7a264a9c4c {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:29:37.781693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:37.790565 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:37.792174 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:37.793346 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c732188d-2c90-4052-9e0b-aa75a2fee19e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 200 len: 1371 microversion: 2.20 time: 0.097271 May 13 13:29:37.793928 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 311/644] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:37 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:38.250544 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-905e4494-120a-4ada-83a8-1b40af5b8c52 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:38.251900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-905e4494-120a-4ada-83a8-1b40af5b8c52 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:38.258357 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-905e4494-120a-4ada-83a8-1b40af5b8c52 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:38.259016 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-905e4494-120a-4ada-83a8-1b40af5b8c52 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:38.260579 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-905e4494-120a-4ada-83a8-1b40af5b8c52 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:38.261195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-905e4494-120a-4ada-83a8-1b40af5b8c52 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:38.423056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-905e4494-120a-4ada-83a8-1b40af5b8c52 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:38.429693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3a78006d-fe39-4067-a2ef-7c161602141f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:38.430357 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3a78006d-fe39-4067-a2ef-7c161602141f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:38.431722 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-905e4494-120a-4ada-83a8-1b40af5b8c52 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.185774 May 13 13:29:38.432471 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 334/645] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:38 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:38.438527 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3a78006d-fe39-4067-a2ef-7c161602141f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:38.439008 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3a78006d-fe39-4067-a2ef-7c161602141f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:38.439805 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3a78006d-fe39-4067-a2ef-7c161602141f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:38.440253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3a78006d-fe39-4067-a2ef-7c161602141f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:38.579836 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3a78006d-fe39-4067-a2ef-7c161602141f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:38.587944 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3a78006d-fe39-4067-a2ef-7c161602141f tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1729 microversion: 2.1 time: 0.162079 May 13 13:29:38.588675 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 312/646] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:38 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:38.604762 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e7c83cb5-8d25-4b1c-9ab7-007d63e015e3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:38.606023 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e7c83cb5-8d25-4b1c-9ab7-007d63e015e3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:38.612422 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e7c83cb5-8d25-4b1c-9ab7-007d63e015e3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:38.613077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e7c83cb5-8d25-4b1c-9ab7-007d63e015e3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:38.614059 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e7c83cb5-8d25-4b1c-9ab7-007d63e015e3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:38.614670 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e7c83cb5-8d25-4b1c-9ab7-007d63e015e3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:38.693940 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e7c83cb5-8d25-4b1c-9ab7-007d63e015e3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092919 May 13 13:29:38.694540 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 335/647] 10.222.0.25 () {58 vars in 1274 bytes} [Fri May 13 13:29:38 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:38.812399 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f491485b-3ffe-478d-9e56-52e543fdd207 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:38.813015 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f491485b-3ffe-478d-9e56-52e543fdd207 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:38.820389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f491485b-3ffe-478d-9e56-52e543fdd207 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:38.820842 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f491485b-3ffe-478d-9e56-52e543fdd207 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:38.821627 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f491485b-3ffe-478d-9e56-52e543fdd207 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:38.822125 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f491485b-3ffe-478d-9e56-52e543fdd207 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:38.837265 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-f491485b-3ffe-478d-9e56-52e543fdd207 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] HTTP exception thrown: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f491485b-3ffe-478d-9e56-52e543fdd207 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Request method failure captured: May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c HTTP/1.1 May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflxAvGRy2tiu2cI_ixQF5FzAx6YJEzimPATwu9Pyi8dPeXq5oZeJBQHTYTQSz8kAy6w2iKF_J6iq10ptUJ4DKvEqmpIpvBAIv5kkRlnyrkUsPbpnpOSvUcgKRMT9hCVeMhv3cZQKSU6q02Ot1ADkR78jtpFAea4YPf-5eK9d8U9gkZU May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 4cd4aa315c4340a1a649d8c51cea0da9 May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:29:38.839019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:29:38.840711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4cd4aa315c4340a1a649d8c51cea0da9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:29:38.840711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:29:38.840711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 4cd4aa315c4340a1a649d8c51cea0da9 May 13 13:29:38.840711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:29:38.840711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeShelveTestJSON-190877774-project May 13 13:29:38.840711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:29:38.840711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:29:38.840711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 08b9fbf87cfa417fbea857ae602a140e May 13 13:29:38.840711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeShelveTestJSON-190877774-project May 13 13:29:38.840711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:29:38.840711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:29:38.840711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '89412841-b653-4a80-8cde-0c7a264a9c4c'} May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:29:38.841525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:29:38.842814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:29:38.843883 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f491485b-3ffe-478d-9e56-52e543fdd207 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Returning 404 to user: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:29:38.843883 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f491485b-3ffe-478d-9e56-52e543fdd207 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 404 len: 111 microversion: 2.20 time: 0.032608 May 13 13:29:38.843883 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 313/648] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:38 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:29:38.849776 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8e1d9f59-5cb6-4ef4-bd9c-1a19e24f9a5a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '.version_select at 0x7faaa1ebc670>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:38.941900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8e1d9f59-5cb6-4ef4-bd9c-1a19e24f9a5a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930936376" status: 204 len: 0 microversion: 2.20 time: 0.095820 May 13 13:29:38.943376 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 336/649] 10.222.0.25 () {60 vars in 1261 bytes} [Fri May 13 13:29:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930936376 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 13:29:39.448706 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b1089625-1917-4ea8-b343-b2791ae057d2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:39.450222 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b1089625-1917-4ea8-b343-b2791ae057d2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:39.458199 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b1089625-1917-4ea8-b343-b2791ae057d2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:39.458945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b1089625-1917-4ea8-b343-b2791ae057d2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:39.460004 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b1089625-1917-4ea8-b343-b2791ae057d2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:39.460655 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b1089625-1917-4ea8-b343-b2791ae057d2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:39.654544 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b1089625-1917-4ea8-b343-b2791ae057d2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:39.662568 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b1089625-1917-4ea8-b343-b2791ae057d2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1266 microversion: 2.1 time: 0.217807 May 13 13:29:39.663129 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 314/650] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:39 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:39.868181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-64ccb3d8-686f-447a-a9f8-e376bd757534 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Action: 'create', calling method: .version_select at 0x7faaa1d63550>, body: {"keypair": {"name": "tempest-keypair-2090882881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLU0zSfQZOd6dlFl3j3v4rYCzbOSQ0FCsvWjbU2mRY9mH6cpYuF92nSW43S3JvN4NhqEPQC01/weqD5u9LjK0TsuE4yiOgu3BTe5/mzNvJaxqrNBhueYX0LUjJo312XhmA=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:39.882859 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-64ccb3d8-686f-447a-a9f8-e376bd757534 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Getting quotas for project 4cd4aa315c4340a1a649d8c51cea0da9. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:29:39.887812 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-64ccb3d8-686f-447a-a9f8-e376bd757534 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Getting quotas for user 08b9fbf87cfa417fbea857ae602a140e and project 4cd4aa315c4340a1a649d8c51cea0da9. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:29:39.992018 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-64ccb3d8-686f-447a-a9f8-e376bd757534 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.128210 May 13 13:29:39.992792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 337/651] 10.222.0.25 () {62 vars in 1199 bytes} [Fri May 13 13:29:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 13 13:29:40.086012 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-fde27efe-7043-40c2-8b1a-1970690b649c req-96e5d971-5626-4330-a9f3-f2092ccb18ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8063f90-dde5-4697-b772-2d63abfae0ec", "tag": "ca45ea26-ebef-4cf1-b670-b108bd4e54d4"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:40.094466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-fde27efe-7043-40c2-8b1a-1970690b649c req-96e5d971-5626-4330-a9f3-f2092ccb18ff service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:40.094925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-fde27efe-7043-40c2-8b1a-1970690b649c req-96e5d971-5626-4330-a9f3-f2092ccb18ff service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:40.117931 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-fde27efe-7043-40c2-8b1a-1970690b649c req-96e5d971-5626-4330-a9f3-f2092ccb18ff service nova] Creating event network-changed:ca45ea26-ebef-4cf1-b670-b108bd4e54d4 for instance c8063f90-dde5-4697-b772-2d63abfae0ec on hv-cinder-84159 May 13 13:29:40.123005 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-fde27efe-7043-40c2-8b1a-1970690b649c req-96e5d971-5626-4330-a9f3-f2092ccb18ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040870 May 13 13:29:40.124295 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 315/652] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:40.679529 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d48a13b1-87e8-4cb0-8dde-9eedfb6b4c62 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:40.680461 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d48a13b1-87e8-4cb0-8dde-9eedfb6b4c62 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:40.687410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d48a13b1-87e8-4cb0-8dde-9eedfb6b4c62 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:40.687859 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d48a13b1-87e8-4cb0-8dde-9eedfb6b4c62 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:40.688642 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d48a13b1-87e8-4cb0-8dde-9eedfb6b4c62 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:40.689075 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d48a13b1-87e8-4cb0-8dde-9eedfb6b4c62 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:40.848518 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d48a13b1-87e8-4cb0-8dde-9eedfb6b4c62 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:40.861034 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d48a13b1-87e8-4cb0-8dde-9eedfb6b4c62 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1453 microversion: 2.1 time: 0.185525 May 13 13:29:40.861799 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 338/653] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:40 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:40.879902 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b470e217-6120-463b-8b2f-0291a8af5471 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:40.880682 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b470e217-6120-463b-8b2f-0291a8af5471 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:40.898971 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b470e217-6120-463b-8b2f-0291a8af5471 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:40.903780 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b470e217-6120-463b-8b2f-0291a8af5471 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:40.903780 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b470e217-6120-463b-8b2f-0291a8af5471 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:40.903780 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b470e217-6120-463b-8b2f-0291a8af5471 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:41.127334 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b470e217-6120-463b-8b2f-0291a8af5471 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:41.135760 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b470e217-6120-463b-8b2f-0291a8af5471 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1453 microversion: 2.1 time: 0.261028 May 13 13:29:41.146075 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 316/654] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:40 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1453 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:42.143692 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-dc873307-32a5-4737-a4a7-337bbfdd42cb req-300e9989-7d19-41d6-b108-6b0a7ae83a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8063f90-dde5-4697-b772-2d63abfae0ec", "tag": "ca45ea26-ebef-4cf1-b670-b108bd4e54d4"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:42.152002 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-dc873307-32a5-4737-a4a7-337bbfdd42cb req-300e9989-7d19-41d6-b108-6b0a7ae83a1a service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:42.152446 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-dc873307-32a5-4737-a4a7-337bbfdd42cb req-300e9989-7d19-41d6-b108-6b0a7ae83a1a service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:42.164423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-dc873307-32a5-4737-a4a7-337bbfdd42cb req-300e9989-7d19-41d6-b108-6b0a7ae83a1a service nova] Creating event network-changed:ca45ea26-ebef-4cf1-b670-b108bd4e54d4 for instance c8063f90-dde5-4697-b772-2d63abfae0ec on hv-cinder-84159 May 13 13:29:42.169484 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-dc873307-32a5-4737-a4a7-337bbfdd42cb req-300e9989-7d19-41d6-b108-6b0a7ae83a1a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029927 May 13 13:29:42.176829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 339/655] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:43.081120 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1453270433", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1652406e-a728-4ceb-93be-3e053ed6049d"}], "security_groups": [{"name": "tempest-securitygroup--1502011041"}], "key_name": "tempest-keypair-2090882881", "user_data": "}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:43.197144 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.network.neutron [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] validate_networks() for [('1652406e-a728-4ceb-93be-3e053ed6049d', None, None, None, None, None)] {{(pid=117602) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:29:43.615747 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Flavor limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:29:43.616243 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Image limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:29:43.616750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Flavor pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:29:43.617159 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Image pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:29:43.617570 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:29:43.627825 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:43.628281 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:43.629100 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:43.629688 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:43.646883 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Getting quotas for project 4cd4aa315c4340a1a649d8c51cea0da9. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:29:43.651048 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Getting quotas for user 08b9fbf87cfa417fbea857ae602a140e and project 4cd4aa315c4340a1a649d8c51cea0da9. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:29:43.662410 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Going to run 1 instances... {{(pid=117602) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:29:43.664697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:29:43.815988 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3c1e1a45-be62-4107-9379-cea8912f3f65 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.739725 May 13 13:29:43.816773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 317/656] 10.222.0.25 () {62 vars in 1187 bytes} [Fri May 13 13:29:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 13 13:29:43.827877 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4f2cdd6c-a9c4-4a11-89c8-dd98f880b183 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:43.828855 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4f2cdd6c-a9c4-4a11-89c8-dd98f880b183 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:43.885439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4f2cdd6c-a9c4-4a11-89c8-dd98f880b183 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:43.892931 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4f2cdd6c-a9c4-4a11-89c8-dd98f880b183 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:43.894762 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4f2cdd6c-a9c4-4a11-89c8-dd98f880b183 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:43.896072 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4f2cdd6c-a9c4-4a11-89c8-dd98f880b183 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1282 microversion: 2.20 time: 0.073014 May 13 13:29:43.896707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 340/657] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:43 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:44.269710 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-b9f52961-a437-4d02-aa64-803c4c7a864e req-34665f31-0225-463d-b47e-4d9ed11051db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c", "tag": "d1cd2559-b1b4-466c-9ab5-45773dffdb54"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:44.279460 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-b9f52961-a437-4d02-aa64-803c4c7a864e req-34665f31-0225-463d-b47e-4d9ed11051db service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:44.281121 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-b9f52961-a437-4d02-aa64-803c4c7a864e req-34665f31-0225-463d-b47e-4d9ed11051db service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:44.294562 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-b9f52961-a437-4d02-aa64-803c4c7a864e req-34665f31-0225-463d-b47e-4d9ed11051db service nova] Creating event network-changed:d1cd2559-b1b4-466c-9ab5-45773dffdb54 for instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c on hv-cinder-84159 May 13 13:29:44.299937 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-b9f52961-a437-4d02-aa64-803c4c7a864e req-34665f31-0225-463d-b47e-4d9ed11051db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040585 May 13 13:29:44.300553 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 318/658] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:44.914873 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e07fb487-80ee-4ff4-aae4-35ee4fbacaa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:44.915470 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e07fb487-80ee-4ff4-aae4-35ee4fbacaa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:44.922933 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e07fb487-80ee-4ff4-aae4-35ee4fbacaa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:44.923397 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e07fb487-80ee-4ff4-aae4-35ee4fbacaa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:44.924231 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e07fb487-80ee-4ff4-aae4-35ee4fbacaa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:44.924617 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e07fb487-80ee-4ff4-aae4-35ee4fbacaa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:44.986309 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e07fb487-80ee-4ff4-aae4-35ee4fbacaa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:44.994146 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e07fb487-80ee-4ff4-aae4-35ee4fbacaa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:44.995829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e07fb487-80ee-4ff4-aae4-35ee4fbacaa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:44.996924 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e07fb487-80ee-4ff4-aae4-35ee4fbacaa2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1286 microversion: 2.20 time: 0.086012 May 13 13:29:44.997462 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 341/659] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:44 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:29:46.018103 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e1bd387c-9b38-4a11-9da1-8b5c8dae10ee tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:46.018770 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e1bd387c-9b38-4a11-9da1-8b5c8dae10ee tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:46.025665 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e1bd387c-9b38-4a11-9da1-8b5c8dae10ee tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:46.026237 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e1bd387c-9b38-4a11-9da1-8b5c8dae10ee tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:46.027161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e1bd387c-9b38-4a11-9da1-8b5c8dae10ee tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:46.027539 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e1bd387c-9b38-4a11-9da1-8b5c8dae10ee tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:46.091846 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e1bd387c-9b38-4a11-9da1-8b5c8dae10ee tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:46.099655 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e1bd387c-9b38-4a11-9da1-8b5c8dae10ee tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:46.101212 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e1bd387c-9b38-4a11-9da1-8b5c8dae10ee tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:46.102349 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e1bd387c-9b38-4a11-9da1-8b5c8dae10ee tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1334 microversion: 2.20 time: 0.089521 May 13 13:29:46.102908 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 319/660] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:46 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:47.120607 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7270fdcd-a0cf-4dad-bcaf-612be5c5f631 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:47.121261 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7270fdcd-a0cf-4dad-bcaf-612be5c5f631 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:47.128227 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7270fdcd-a0cf-4dad-bcaf-612be5c5f631 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:47.128676 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7270fdcd-a0cf-4dad-bcaf-612be5c5f631 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:47.129439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7270fdcd-a0cf-4dad-bcaf-612be5c5f631 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:47.129896 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7270fdcd-a0cf-4dad-bcaf-612be5c5f631 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:47.189752 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7270fdcd-a0cf-4dad-bcaf-612be5c5f631 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:47.197385 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7270fdcd-a0cf-4dad-bcaf-612be5c5f631 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:47.198891 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7270fdcd-a0cf-4dad-bcaf-612be5c5f631 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:47.199975 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7270fdcd-a0cf-4dad-bcaf-612be5c5f631 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1352 microversion: 2.20 time: 0.083425 May 13 13:29:47.200531 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 342/661] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:47 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:48.219122 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ba444812-6deb-4888-a556-aeb80f3bb6b4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:48.219703 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ba444812-6deb-4888-a556-aeb80f3bb6b4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:48.226222 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ba444812-6deb-4888-a556-aeb80f3bb6b4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:48.226678 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ba444812-6deb-4888-a556-aeb80f3bb6b4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:48.227457 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ba444812-6deb-4888-a556-aeb80f3bb6b4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:48.229856 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ba444812-6deb-4888-a556-aeb80f3bb6b4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:48.296191 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ba444812-6deb-4888-a556-aeb80f3bb6b4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:48.303983 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ba444812-6deb-4888-a556-aeb80f3bb6b4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:48.305579 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ba444812-6deb-4888-a556-aeb80f3bb6b4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:48.306761 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ba444812-6deb-4888-a556-aeb80f3bb6b4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1340 microversion: 2.20 time: 0.092288 May 13 13:29:48.307324 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 320/662] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:48 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:49.324857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-77c38c4c-0f7a-43c8-9051-c11e9fec00ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:49.325472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-77c38c4c-0f7a-43c8-9051-c11e9fec00ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:49.332154 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-77c38c4c-0f7a-43c8-9051-c11e9fec00ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:49.334565 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-77c38c4c-0f7a-43c8-9051-c11e9fec00ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:49.334565 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-77c38c4c-0f7a-43c8-9051-c11e9fec00ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:49.334565 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-77c38c4c-0f7a-43c8-9051-c11e9fec00ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:49.466581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-77c38c4c-0f7a-43c8-9051-c11e9fec00ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:49.474967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-77c38c4c-0f7a-43c8-9051-c11e9fec00ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:49.476613 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-77c38c4c-0f7a-43c8-9051-c11e9fec00ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:49.477876 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-77c38c4c-0f7a-43c8-9051-c11e9fec00ef tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1408 microversion: 2.20 time: 0.156840 May 13 13:29:49.478444 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 343/663] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:49 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:50.496740 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-624f6abf-1d77-46ef-abff-45bf81da77dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:50.498757 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-624f6abf-1d77-46ef-abff-45bf81da77dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:50.506064 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-624f6abf-1d77-46ef-abff-45bf81da77dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:50.506520 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-624f6abf-1d77-46ef-abff-45bf81da77dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:50.506713 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-89e7bbc2-d74f-4706-ada9-8a7e81a3a80e req-31c32a2b-f85e-41c4-a3e7-4e28026b9ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3", "tag": "ed34b0e2-4b0c-4721-9e85-8167943bb597"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:50.507999 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-624f6abf-1d77-46ef-abff-45bf81da77dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:50.508613 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-624f6abf-1d77-46ef-abff-45bf81da77dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:50.525135 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-89e7bbc2-d74f-4706-ada9-8a7e81a3a80e req-31c32a2b-f85e-41c4-a3e7-4e28026b9ed2 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:50.526051 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-89e7bbc2-d74f-4706-ada9-8a7e81a3a80e req-31c32a2b-f85e-41c4-a3e7-4e28026b9ed2 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:50.546607 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-89e7bbc2-d74f-4706-ada9-8a7e81a3a80e req-31c32a2b-f85e-41c4-a3e7-4e28026b9ed2 service nova] Creating event network-changed:ed34b0e2-4b0c-4721-9e85-8167943bb597 for instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 on hv-cinder-84159 May 13 13:29:50.553710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-89e7bbc2-d74f-4706-ada9-8a7e81a3a80e req-31c32a2b-f85e-41c4-a3e7-4e28026b9ed2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054324 May 13 13:29:50.554461 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 344/664] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:50.659479 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-624f6abf-1d77-46ef-abff-45bf81da77dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:50.665778 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-624f6abf-1d77-46ef-abff-45bf81da77dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:50.667297 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-624f6abf-1d77-46ef-abff-45bf81da77dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:50.668422 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-624f6abf-1d77-46ef-abff-45bf81da77dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1408 microversion: 2.20 time: 0.176054 May 13 13:29:50.668982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 321/665] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:50 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:51.687245 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1549032e-4958-48a6-b4bd-6edd8fe2e11e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:51.688428 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1549032e-4958-48a6-b4bd-6edd8fe2e11e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:51.694860 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1549032e-4958-48a6-b4bd-6edd8fe2e11e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:51.695312 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1549032e-4958-48a6-b4bd-6edd8fe2e11e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:51.696078 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1549032e-4958-48a6-b4bd-6edd8fe2e11e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:51.696518 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1549032e-4958-48a6-b4bd-6edd8fe2e11e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:51.825299 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1549032e-4958-48a6-b4bd-6edd8fe2e11e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:51.833727 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1549032e-4958-48a6-b4bd-6edd8fe2e11e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:51.835314 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1549032e-4958-48a6-b4bd-6edd8fe2e11e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:51.836424 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1549032e-4958-48a6-b4bd-6edd8fe2e11e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1408 microversion: 2.20 time: 0.153430 May 13 13:29:51.836984 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 345/666] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:51 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:52.854372 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1cf94331-2d02-4414-9a71-57d76bfa43d7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:52.854988 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1cf94331-2d02-4414-9a71-57d76bfa43d7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:52.861477 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1cf94331-2d02-4414-9a71-57d76bfa43d7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:52.861987 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1cf94331-2d02-4414-9a71-57d76bfa43d7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:52.862769 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1cf94331-2d02-4414-9a71-57d76bfa43d7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:52.863214 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1cf94331-2d02-4414-9a71-57d76bfa43d7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:52.990933 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1cf94331-2d02-4414-9a71-57d76bfa43d7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:52.996453 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1cf94331-2d02-4414-9a71-57d76bfa43d7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:52.998045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1cf94331-2d02-4414-9a71-57d76bfa43d7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:52.999145 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1cf94331-2d02-4414-9a71-57d76bfa43d7 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1408 microversion: 2.20 time: 0.148742 May 13 13:29:52.999694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 322/667] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:52 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:54.017099 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-acccf5fd-350c-493d-b8bb-1a21e0f4f747 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:54.017738 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-acccf5fd-350c-493d-b8bb-1a21e0f4f747 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:54.024104 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-acccf5fd-350c-493d-b8bb-1a21e0f4f747 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:54.024561 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-acccf5fd-350c-493d-b8bb-1a21e0f4f747 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:54.025339 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-acccf5fd-350c-493d-b8bb-1a21e0f4f747 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:54.025805 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-acccf5fd-350c-493d-b8bb-1a21e0f4f747 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:54.134993 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f2231886-2bf4-4b9e-9b71-a74df1f1e5ba tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:54.135519 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f2231886-2bf4-4b9e-9b71-a74df1f1e5ba tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:54.141394 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f2231886-2bf4-4b9e-9b71-a74df1f1e5ba tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:54.141869 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f2231886-2bf4-4b9e-9b71-a74df1f1e5ba tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:54.142634 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f2231886-2bf4-4b9e-9b71-a74df1f1e5ba tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:54.143068 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f2231886-2bf4-4b9e-9b71-a74df1f1e5ba tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:54.158692 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-acccf5fd-350c-493d-b8bb-1a21e0f4f747 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:54.166487 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-acccf5fd-350c-493d-b8bb-1a21e0f4f747 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:54.167994 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-acccf5fd-350c-493d-b8bb-1a21e0f4f747 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:54.169241 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-acccf5fd-350c-493d-b8bb-1a21e0f4f747 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1408 microversion: 2.20 time: 0.156059 May 13 13:29:54.169840 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 346/668] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:54 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:54.222685 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-f2231886-2bf4-4b9e-9b71-a74df1f1e5ba tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lazy-loading 'services' on Instance uuid 16a2ed3f-3b98-4052-9f7f-934179a73cbe {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:29:54.442786 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f2231886-2bf4-4b9e-9b71-a74df1f1e5ba tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "DELETE /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe/os-volume_attachments/d57ae1b3-2725-43f6-9f74-567e518ae3d2" status: 202 len: 0 microversion: 2.1 time: 0.311467 May 13 13:29:54.443383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 323/669] 10.222.0.25 () {58 vars in 1415 bytes} [Fri May 13 13:29:54 2022] DELETE /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe/os-volume_attachments/d57ae1b3-2725-43f6-9f74-567e518ae3d2 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:29:55.188686 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d009a34a-8f4c-4fc4-89d2-7675109369de tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:55.189388 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d009a34a-8f4c-4fc4-89d2-7675109369de tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:55.196051 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d009a34a-8f4c-4fc4-89d2-7675109369de tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:55.196726 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d009a34a-8f4c-4fc4-89d2-7675109369de tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:55.197511 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d009a34a-8f4c-4fc4-89d2-7675109369de tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:55.197988 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d009a34a-8f4c-4fc4-89d2-7675109369de tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:55.331987 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d009a34a-8f4c-4fc4-89d2-7675109369de tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:55.340003 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d009a34a-8f4c-4fc4-89d2-7675109369de tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:55.341503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d009a34a-8f4c-4fc4-89d2-7675109369de tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:55.342642 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d009a34a-8f4c-4fc4-89d2-7675109369de tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1408 microversion: 2.20 time: 0.159003 May 13 13:29:55.343239 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 347/670] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:55 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:56.361461 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f97cd288-727f-45c6-9b90-e14bf121772b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:56.362198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f97cd288-727f-45c6-9b90-e14bf121772b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:56.368322 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f97cd288-727f-45c6-9b90-e14bf121772b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:56.368772 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f97cd288-727f-45c6-9b90-e14bf121772b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:56.369541 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f97cd288-727f-45c6-9b90-e14bf121772b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:56.370018 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f97cd288-727f-45c6-9b90-e14bf121772b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:56.507013 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f97cd288-727f-45c6-9b90-e14bf121772b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:56.514933 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f97cd288-727f-45c6-9b90-e14bf121772b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:56.516480 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f97cd288-727f-45c6-9b90-e14bf121772b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:56.517589 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f97cd288-727f-45c6-9b90-e14bf121772b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1408 microversion: 2.20 time: 0.160895 May 13 13:29:56.518179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 324/671] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:56 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:56.617890 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ee275c7b-a30a-4507-80b0-d078755eea5a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:56.618432 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ee275c7b-a30a-4507-80b0-d078755eea5a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:56.624857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ee275c7b-a30a-4507-80b0-d078755eea5a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:56.625938 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ee275c7b-a30a-4507-80b0-d078755eea5a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:56.626706 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ee275c7b-a30a-4507-80b0-d078755eea5a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:56.627149 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ee275c7b-a30a-4507-80b0-d078755eea5a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:56.654017 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ee275c7b-a30a-4507-80b0-d078755eea5a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:29:56.797312 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-63741de8-c93a-4d4f-b703-9a56dc35f1d5 req-3ecde129-3e7e-46f3-8c05-d1f442178c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3", "name": "network-vif-plugged", "status": "completed", "tag": "ed34b0e2-4b0c-4721-9e85-8167943bb597"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:56.805383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-63741de8-c93a-4d4f-b703-9a56dc35f1d5 req-3ecde129-3e7e-46f3-8c05-d1f442178c83 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:56.805861 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-63741de8-c93a-4d4f-b703-9a56dc35f1d5 req-3ecde129-3e7e-46f3-8c05-d1f442178c83 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:56.817360 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-63741de8-c93a-4d4f-b703-9a56dc35f1d5 req-3ecde129-3e7e-46f3-8c05-d1f442178c83 service nova] Creating event network-vif-plugged:ed34b0e2-4b0c-4721-9e85-8167943bb597 for instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 on hv-cinder-84159 May 13 13:29:56.822379 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-63741de8-c93a-4d4f-b703-9a56dc35f1d5 req-3ecde129-3e7e-46f3-8c05-d1f442178c83 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029288 May 13 13:29:56.823027 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 325/672] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:29:57.066580 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ee275c7b-a30a-4507-80b0-d078755eea5a tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "DELETE /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 204 len: 0 microversion: 2.1 time: 0.452161 May 13 13:29:57.067114 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 348/673] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:29:56 2022] DELETE /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:29:57.075821 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6fc01f7b-d5ed-4fb2-8f7c-f68760703b88 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:57.076515 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6fc01f7b-d5ed-4fb2-8f7c-f68760703b88 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:57.082947 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6fc01f7b-d5ed-4fb2-8f7c-f68760703b88 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:57.083395 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6fc01f7b-d5ed-4fb2-8f7c-f68760703b88 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:57.084152 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6fc01f7b-d5ed-4fb2-8f7c-f68760703b88 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:57.084590 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6fc01f7b-d5ed-4fb2-8f7c-f68760703b88 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:57.216234 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6fc01f7b-d5ed-4fb2-8f7c-f68760703b88 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:57.223995 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6fc01f7b-d5ed-4fb2-8f7c-f68760703b88 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1515 microversion: 2.1 time: 0.152346 May 13 13:29:57.224557 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 326/674] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:57 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:57.536334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-651800e0-c0c3-4ff5-80fc-7fcbfa9fd720 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:57.537066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-651800e0-c0c3-4ff5-80fc-7fcbfa9fd720 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:57.543129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-651800e0-c0c3-4ff5-80fc-7fcbfa9fd720 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:57.543591 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-651800e0-c0c3-4ff5-80fc-7fcbfa9fd720 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:57.544373 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-651800e0-c0c3-4ff5-80fc-7fcbfa9fd720 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:57.544817 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-651800e0-c0c3-4ff5-80fc-7fcbfa9fd720 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:57.672395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-651800e0-c0c3-4ff5-80fc-7fcbfa9fd720 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:57.680007 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-651800e0-c0c3-4ff5-80fc-7fcbfa9fd720 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:57.681480 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-651800e0-c0c3-4ff5-80fc-7fcbfa9fd720 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:57.682601 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-651800e0-c0c3-4ff5-80fc-7fcbfa9fd720 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1408 microversion: 2.20 time: 0.151289 May 13 13:29:57.683160 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 349/675] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:57 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:58.240909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-643f1992-2176-487f-b22a-590e6d9c1c35 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:58.241527 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-643f1992-2176-487f-b22a-590e6d9c1c35 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:58.247996 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-643f1992-2176-487f-b22a-590e6d9c1c35 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:58.248450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-643f1992-2176-487f-b22a-590e6d9c1c35 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:58.249221 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-643f1992-2176-487f-b22a-590e6d9c1c35 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:58.249663 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-643f1992-2176-487f-b22a-590e6d9c1c35 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:58.389133 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-643f1992-2176-487f-b22a-590e6d9c1c35 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:58.398233 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-643f1992-2176-487f-b22a-590e6d9c1c35 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1515 microversion: 2.1 time: 0.161140 May 13 13:29:58.398810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 327/676] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:58 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:29:58.702454 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-48fa28a9-8c8d-4d65-ae7e-7a024f47b652 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:58.703115 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-48fa28a9-8c8d-4d65-ae7e-7a024f47b652 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:58.709631 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48fa28a9-8c8d-4d65-ae7e-7a024f47b652 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:58.710126 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48fa28a9-8c8d-4d65-ae7e-7a024f47b652 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:58.710906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48fa28a9-8c8d-4d65-ae7e-7a024f47b652 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:58.711348 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48fa28a9-8c8d-4d65-ae7e-7a024f47b652 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:58.870425 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-48fa28a9-8c8d-4d65-ae7e-7a024f47b652 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:58.878799 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-48fa28a9-8c8d-4d65-ae7e-7a024f47b652 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:58.880361 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-48fa28a9-8c8d-4d65-ae7e-7a024f47b652 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:58.881458 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-48fa28a9-8c8d-4d65-ae7e-7a024f47b652 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1408 microversion: 2.20 time: 0.184182 May 13 13:29:58.882052 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 350/677] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:58 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:29:59.416232 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8984645a-b3f8-4a69-bc76-47ccade5a088 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:59.416845 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8984645a-b3f8-4a69-bc76-47ccade5a088 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:59.423851 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8984645a-b3f8-4a69-bc76-47ccade5a088 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:59.424308 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8984645a-b3f8-4a69-bc76-47ccade5a088 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:59.425082 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8984645a-b3f8-4a69-bc76-47ccade5a088 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:59.425524 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8984645a-b3f8-4a69-bc76-47ccade5a088 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:59.562709 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-8984645a-b3f8-4a69-bc76-47ccade5a088 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:29:59.570547 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8984645a-b3f8-4a69-bc76-47ccade5a088 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1515 microversion: 2.1 time: 0.158237 May 13 13:29:59.571129 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 328/678] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:29:59 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:29:59.823384 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-18adc22c-c990-42c9-ad4a-740af3baecc7 req-9115ce4e-f6a9-4390-a0dd-8cb7e1334428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a2ed3f-3b98-4052-9f7f-934179a73cbe", "name": "network-vif-deleted", "tag": "2e260ecb-d92a-4742-8e06-f69dee207767"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:29:59.832211 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-18adc22c-c990-42c9-ad4a-740af3baecc7 req-9115ce4e-f6a9-4390-a0dd-8cb7e1334428 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:59.832661 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-18adc22c-c990-42c9-ad4a-740af3baecc7 req-9115ce4e-f6a9-4390-a0dd-8cb7e1334428 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:59.843605 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-18adc22c-c990-42c9-ad4a-740af3baecc7 req-9115ce4e-f6a9-4390-a0dd-8cb7e1334428 service nova] Creating event network-vif-deleted:2e260ecb-d92a-4742-8e06-f69dee207767 for instance 16a2ed3f-3b98-4052-9f7f-934179a73cbe on hv-cinder-84159 May 13 13:29:59.848295 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-18adc22c-c990-42c9-ad4a-740af3baecc7 req-9115ce4e-f6a9-4390-a0dd-8cb7e1334428 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028531 May 13 13:29:59.848860 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 351/679] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:29:59.899130 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-964ce973-8ce4-43cc-a694-aca21761a875 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:29:59.899770 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-964ce973-8ce4-43cc-a694-aca21761a875 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:29:59.905645 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-964ce973-8ce4-43cc-a694-aca21761a875 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:59.906139 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-964ce973-8ce4-43cc-a694-aca21761a875 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:29:59.906910 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-964ce973-8ce4-43cc-a694-aca21761a875 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:29:59.907356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-964ce973-8ce4-43cc-a694-aca21761a875 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:00.035743 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-964ce973-8ce4-43cc-a694-aca21761a875 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:00.043493 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-964ce973-8ce4-43cc-a694-aca21761a875 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:00.045008 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-964ce973-8ce4-43cc-a694-aca21761a875 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:00.046140 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-964ce973-8ce4-43cc-a694-aca21761a875 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1408 microversion: 2.20 time: 0.150833 May 13 13:30:00.046708 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 329/680] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:29:59 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:30:00.588793 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-330af588-6648-4fba-b3a4-d039354d058e tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:00.589412 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-330af588-6648-4fba-b3a4-d039354d058e tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:00.596027 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-330af588-6648-4fba-b3a4-d039354d058e tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:00.596485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-330af588-6648-4fba-b3a4-d039354d058e tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:00.597256 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-330af588-6648-4fba-b3a4-d039354d058e tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:00.597698 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-330af588-6648-4fba-b3a4-d039354d058e tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:00.627487 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-330af588-6648-4fba-b3a4-d039354d058e tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:00.627942 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-330af588-6648-4fba-b3a4-d039354d058e tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:00.628397 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-330af588-6648-4fba-b3a4-d039354d058e tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lazy-loading 'fault' on Instance uuid 16a2ed3f-3b98-4052-9f7f-934179a73cbe {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:30:00.668629 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-330af588-6648-4fba-b3a4-d039354d058e tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15932bb7b3044a41942b4e0edecebf10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b361133457c04e2da4c4158a45bbcf19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:00.676663 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-330af588-6648-4fba-b3a4-d039354d058e tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 200 len: 1309 microversion: 2.1 time: 0.092096 May 13 13:30:00.677238 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 352/681] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:00 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:01.066412 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-bb85eb34-5aa4-4d8f-9e5b-c75f93f5bbb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:01.067023 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-bb85eb34-5aa4-4d8f-9e5b-c75f93f5bbb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:01.073410 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bb85eb34-5aa4-4d8f-9e5b-c75f93f5bbb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:01.073898 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bb85eb34-5aa4-4d8f-9e5b-c75f93f5bbb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:01.074674 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bb85eb34-5aa4-4d8f-9e5b-c75f93f5bbb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:01.075123 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bb85eb34-5aa4-4d8f-9e5b-c75f93f5bbb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:01.206805 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bb85eb34-5aa4-4d8f-9e5b-c75f93f5bbb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:01.214529 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bb85eb34-5aa4-4d8f-9e5b-c75f93f5bbb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:01.216012 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bb85eb34-5aa4-4d8f-9e5b-c75f93f5bbb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:01.217148 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-bb85eb34-5aa4-4d8f-9e5b-c75f93f5bbb8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1601 microversion: 2.20 time: 0.154625 May 13 13:30:01.217707 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 330/682] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:30:01 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:30:01.234785 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4890a90c-d5d1-4b14-9b62-3858dd24ff21 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:01.235289 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4890a90c-d5d1-4b14-9b62-3858dd24ff21 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:01.241673 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4890a90c-d5d1-4b14-9b62-3858dd24ff21 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:01.242167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4890a90c-d5d1-4b14-9b62-3858dd24ff21 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:01.242944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4890a90c-d5d1-4b14-9b62-3858dd24ff21 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:01.243387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4890a90c-d5d1-4b14-9b62-3858dd24ff21 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:01.318482 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4890a90c-d5d1-4b14-9b62-3858dd24ff21 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087477 May 13 13:30:01.319048 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 353/683] 10.222.0.25 () {60 vars in 1315 bytes} [Fri May 13 13:30:01 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:30:01.693851 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-afb75530-6777-4b64-9d1a-9a5dacb98f75 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:01.694387 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-afb75530-6777-4b64-9d1a-9a5dacb98f75 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] [instance: 16a2ed3f-3b98-4052-9f7f-934179a73cbe] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:01.700458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-afb75530-6777-4b64-9d1a-9a5dacb98f75 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:01.700911 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-afb75530-6777-4b64-9d1a-9a5dacb98f75 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:01.701683 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-afb75530-6777-4b64-9d1a-9a5dacb98f75 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:01.702148 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-afb75530-6777-4b64-9d1a-9a5dacb98f75 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:01.727684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-afb75530-6777-4b64-9d1a-9a5dacb98f75 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] HTTP exception thrown: Instance 16a2ed3f-3b98-4052-9f7f-934179a73cbe could not be found. May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-afb75530-6777-4b64-9d1a-9a5dacb98f75 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Request method failure captured: May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe HTTP/1.1 May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflyp0KXFRH6syBLY2FsKk4upwAdN8wFjS3K3uQrmN43aaHkQOdGy5-R6FRyblAGAschpmHbDkFkC3PEN4WgYNOcJoB_voKXv-kTskEQ3gKcea_F-9tbyKYJmP8YISH3ASSVr5wYTG6PhPWk630UBaQNM-PT7JrAYSXW1-6YBVD1Etek May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: b361133457c04e2da4c4158a45bbcf19 May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1914169004 May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:30:01.729355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:30:01.730925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b361133457c04e2da4c4158a45bbcf19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b361133457c04e2da4c4158a45bbcf19", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b361133457c04e2da4c4158a45bbcf19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b361133457c04e2da4c4158a45bbcf19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:30:01.730925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-VolumesSnapshotTestJSON-1914169004 May 13 13:30:01.730925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: b361133457c04e2da4c4158a45bbcf19 May 13 13:30:01.730925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1914169004 May 13 13:30:01.730925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-VolumesSnapshotTestJSON-1914169004-project May 13 13:30:01.730925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:30:01.730925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:30:01.730925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 15932bb7b3044a41942b4e0edecebf10 May 13 13:30:01.730925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-VolumesSnapshotTestJSON-1914169004-project May 13 13:30:01.730925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:30:01.730925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 16a2ed3f-3b98-4052-9f7f-934179a73cbe could not be found. May 13 13:30:01.730925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '16a2ed3f-3b98-4052-9f7f-934179a73cbe'} May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16a2ed3f-3b98-4052-9f7f-934179a73cbe could not be found. May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:01.731855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16a2ed3f-3b98-4052-9f7f-934179a73cbe could not be found. May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16a2ed3f-3b98-4052-9f7f-934179a73cbe could not be found. May 13 13:30:01.733439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:01.734698 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-afb75530-6777-4b64-9d1a-9a5dacb98f75 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] Returning 404 to user: Instance 16a2ed3f-3b98-4052-9f7f-934179a73cbe could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:01.734698 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-afb75530-6777-4b64-9d1a-9a5dacb98f75 tempest-VolumesSnapshotTestJSON-1914169004 tempest-VolumesSnapshotTestJSON-1914169004-project] 10.222.0.25 "GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe" status: 404 len: 111 microversion: 2.1 time: 0.040971 May 13 13:30:01.734698 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 331/684] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:01 2022] GET /compute/v2.1/servers/16a2ed3f-3b98-4052-9f7f-934179a73cbe => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:30:02.596579 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-ecb88fd3-8de1-4027-8745-9a2144159ada req-178ec2f0-96e9-460a-990c-a5a896b5e2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3", "tag": "ed34b0e2-4b0c-4721-9e85-8167943bb597"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:02.604733 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ecb88fd3-8de1-4027-8745-9a2144159ada req-178ec2f0-96e9-460a-990c-a5a896b5e2f3 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:02.605245 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ecb88fd3-8de1-4027-8745-9a2144159ada req-178ec2f0-96e9-460a-990c-a5a896b5e2f3 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:02.615994 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-ecb88fd3-8de1-4027-8745-9a2144159ada req-178ec2f0-96e9-460a-990c-a5a896b5e2f3 service nova] Creating event network-changed:ed34b0e2-4b0c-4721-9e85-8167943bb597 for instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 on hv-cinder-84159 May 13 13:30:02.620835 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-ecb88fd3-8de1-4027-8745-9a2144159ada req-178ec2f0-96e9-460a-990c-a5a896b5e2f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028385 May 13 13:30:02.621499 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 354/685] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:30:12.066978 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b4bdc8cd-0bec-4540-ae63-95b8eb485b0f tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:12.067998 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b4bdc8cd-0bec-4540-ae63-95b8eb485b0f tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:12.075059 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b4bdc8cd-0bec-4540-ae63-95b8eb485b0f tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:12.075521 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b4bdc8cd-0bec-4540-ae63-95b8eb485b0f tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:12.076318 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b4bdc8cd-0bec-4540-ae63-95b8eb485b0f tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:12.076760 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b4bdc8cd-0bec-4540-ae63-95b8eb485b0f tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:12.355627 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b4bdc8cd-0bec-4540-ae63-95b8eb485b0f tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "POST /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/action" status: 202 len: 0 microversion: 2.1 time: 0.292440 May 13 13:30:12.356301 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 332/686] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:30:12 2022] POST /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:30:12.365565 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-643d01cb-dda7-4bba-a10c-603af9fc953d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:12.366300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-643d01cb-dda7-4bba-a10c-603af9fc953d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:12.372457 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-643d01cb-dda7-4bba-a10c-603af9fc953d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:12.372905 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-643d01cb-dda7-4bba-a10c-603af9fc953d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:12.373662 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-643d01cb-dda7-4bba-a10c-603af9fc953d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:12.374121 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-643d01cb-dda7-4bba-a10c-603af9fc953d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:12.628803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-643d01cb-dda7-4bba-a10c-603af9fc953d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:12.637025 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-643d01cb-dda7-4bba-a10c-603af9fc953d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1748 microversion: 2.1 time: 0.276045 May 13 13:30:12.637602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 355/687] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:12 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1748 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:13.655853 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7d6fb168-5674-4ef5-a147-ec8cba142e4e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:13.656495 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7d6fb168-5674-4ef5-a147-ec8cba142e4e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:13.662597 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7d6fb168-5674-4ef5-a147-ec8cba142e4e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:13.663054 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7d6fb168-5674-4ef5-a147-ec8cba142e4e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:13.663822 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7d6fb168-5674-4ef5-a147-ec8cba142e4e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:13.664258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7d6fb168-5674-4ef5-a147-ec8cba142e4e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:13.865944 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-7d6fb168-5674-4ef5-a147-ec8cba142e4e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:13.873799 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7d6fb168-5674-4ef5-a147-ec8cba142e4e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.222835 May 13 13:30:13.874367 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 333/688] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:13 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:14.892364 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c6d70926-d095-4ecf-b79c-06e99ef9d4b2 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:14.893016 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c6d70926-d095-4ecf-b79c-06e99ef9d4b2 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:14.899338 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c6d70926-d095-4ecf-b79c-06e99ef9d4b2 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:14.899791 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c6d70926-d095-4ecf-b79c-06e99ef9d4b2 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:14.900569 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c6d70926-d095-4ecf-b79c-06e99ef9d4b2 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:14.901008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c6d70926-d095-4ecf-b79c-06e99ef9d4b2 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:15.042234 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c6d70926-d095-4ecf-b79c-06e99ef9d4b2 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:15.049999 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c6d70926-d095-4ecf-b79c-06e99ef9d4b2 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.162135 May 13 13:30:15.050565 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 356/689] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:14 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:16.066940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-dcdd6100-4720-4042-ad58-78290ff04941 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:16.067564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-dcdd6100-4720-4042-ad58-78290ff04941 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:16.074012 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dcdd6100-4720-4042-ad58-78290ff04941 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:16.074514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dcdd6100-4720-4042-ad58-78290ff04941 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:16.075330 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dcdd6100-4720-4042-ad58-78290ff04941 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:16.075782 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dcdd6100-4720-4042-ad58-78290ff04941 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:16.217210 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-dcdd6100-4720-4042-ad58-78290ff04941 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:16.225602 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-dcdd6100-4720-4042-ad58-78290ff04941 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.162695 May 13 13:30:16.226213 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 334/690] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:16 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:17.243697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-56d0e81f-103f-4283-9cf7-700b54e0c8cf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:17.244255 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-56d0e81f-103f-4283-9cf7-700b54e0c8cf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:17.251954 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56d0e81f-103f-4283-9cf7-700b54e0c8cf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:17.252399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56d0e81f-103f-4283-9cf7-700b54e0c8cf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:17.253174 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56d0e81f-103f-4283-9cf7-700b54e0c8cf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:17.253611 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56d0e81f-103f-4283-9cf7-700b54e0c8cf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:17.398265 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-56d0e81f-103f-4283-9cf7-700b54e0c8cf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:17.406145 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-56d0e81f-103f-4283-9cf7-700b54e0c8cf tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.167380 May 13 13:30:17.406731 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 357/691] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:17 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:18.424570 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-15a5ba56-9ccc-46e1-bb8c-a5948fc0b32c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:18.425121 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-15a5ba56-9ccc-46e1-bb8c-a5948fc0b32c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:18.431499 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-15a5ba56-9ccc-46e1-bb8c-a5948fc0b32c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:18.431953 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-15a5ba56-9ccc-46e1-bb8c-a5948fc0b32c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:18.432730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-15a5ba56-9ccc-46e1-bb8c-a5948fc0b32c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:18.433171 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-15a5ba56-9ccc-46e1-bb8c-a5948fc0b32c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:18.569985 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-15a5ba56-9ccc-46e1-bb8c-a5948fc0b32c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:18.577692 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-15a5ba56-9ccc-46e1-bb8c-a5948fc0b32c tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.157689 May 13 13:30:18.578303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 335/692] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:18 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:30:19.595746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0a31120a-073d-4755-b050-90430ed9958d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:19.596315 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0a31120a-073d-4755-b050-90430ed9958d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:19.602629 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0a31120a-073d-4755-b050-90430ed9958d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:19.603082 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0a31120a-073d-4755-b050-90430ed9958d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:19.603849 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0a31120a-073d-4755-b050-90430ed9958d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:19.604289 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0a31120a-073d-4755-b050-90430ed9958d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:19.746790 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0a31120a-073d-4755-b050-90430ed9958d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:19.755236 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0a31120a-073d-4755-b050-90430ed9958d tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.163844 May 13 13:30:19.755813 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 358/693] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:19 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:20.772463 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3401b034-60b1-47c8-a2d1-b50a7bc288cc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:20.773065 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3401b034-60b1-47c8-a2d1-b50a7bc288cc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:20.779109 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3401b034-60b1-47c8-a2d1-b50a7bc288cc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:20.779605 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3401b034-60b1-47c8-a2d1-b50a7bc288cc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:20.780370 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3401b034-60b1-47c8-a2d1-b50a7bc288cc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:20.780801 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3401b034-60b1-47c8-a2d1-b50a7bc288cc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:20.925999 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3401b034-60b1-47c8-a2d1-b50a7bc288cc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:20.933657 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3401b034-60b1-47c8-a2d1-b50a7bc288cc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.165135 May 13 13:30:20.934250 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 336/694] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:20 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:21.951082 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a7cf4239-b9fa-46bc-b93c-08836c514533 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:21.951701 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a7cf4239-b9fa-46bc-b93c-08836c514533 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:21.958645 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a7cf4239-b9fa-46bc-b93c-08836c514533 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:21.959109 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a7cf4239-b9fa-46bc-b93c-08836c514533 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:21.959889 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a7cf4239-b9fa-46bc-b93c-08836c514533 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:21.960368 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a7cf4239-b9fa-46bc-b93c-08836c514533 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:22.098495 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a7cf4239-b9fa-46bc-b93c-08836c514533 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:22.106259 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a7cf4239-b9fa-46bc-b93c-08836c514533 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.159124 May 13 13:30:22.106835 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 359/695] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:21 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:23.123889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-de10280f-2aed-41e3-afd3-cf347df97a51 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:23.124434 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-de10280f-2aed-41e3-afd3-cf347df97a51 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:23.131541 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-de10280f-2aed-41e3-afd3-cf347df97a51 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:23.131999 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-de10280f-2aed-41e3-afd3-cf347df97a51 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:23.132785 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-de10280f-2aed-41e3-afd3-cf347df97a51 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:23.133223 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-de10280f-2aed-41e3-afd3-cf347df97a51 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:23.272223 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-de10280f-2aed-41e3-afd3-cf347df97a51 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:23.280014 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-de10280f-2aed-41e3-afd3-cf347df97a51 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.160056 May 13 13:30:23.280635 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 337/696] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:23 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:23.555869 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0cf7ddbe-173f-48b8-9b88-13a5c80683e9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:23.557061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0cf7ddbe-173f-48b8-9b88-13a5c80683e9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:23.564071 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0cf7ddbe-173f-48b8-9b88-13a5c80683e9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:23.564525 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0cf7ddbe-173f-48b8-9b88-13a5c80683e9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:23.565301 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0cf7ddbe-173f-48b8-9b88-13a5c80683e9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:23.565747 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0cf7ddbe-173f-48b8-9b88-13a5c80683e9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:23.598020 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0cf7ddbe-173f-48b8-9b88-13a5c80683e9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046049 May 13 13:30:23.598581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 360/697] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:30:23 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:30:23.654161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3af5fb4f-6aa7-4740-9692-b65cc4419651 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:23.654670 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3af5fb4f-6aa7-4740-9692-b65cc4419651 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:23.660512 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3af5fb4f-6aa7-4740-9692-b65cc4419651 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:23.660968 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3af5fb4f-6aa7-4740-9692-b65cc4419651 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:23.661749 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3af5fb4f-6aa7-4740-9692-b65cc4419651 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:23.662217 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3af5fb4f-6aa7-4740-9692-b65cc4419651 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:23.686450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3af5fb4f-6aa7-4740-9692-b65cc4419651 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Going to try to terminate instance {{(pid=117602) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:30:24.008661 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3af5fb4f-6aa7-4740-9692-b65cc4419651 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 204 len: 0 microversion: 2.1 time: 0.358181 May 13 13:30:24.009263 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 338/698] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:30:23 2022] DELETE /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:30:24.020962 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-136843e5-2c3f-4625-9908-08c39a97bbe8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:24.020962 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-136843e5-2c3f-4625-9908-08c39a97bbe8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:24.025865 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-136843e5-2c3f-4625-9908-08c39a97bbe8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:24.028480 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-136843e5-2c3f-4625-9908-08c39a97bbe8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:24.028480 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-136843e5-2c3f-4625-9908-08c39a97bbe8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:24.028480 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-136843e5-2c3f-4625-9908-08c39a97bbe8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:24.156735 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-136843e5-2c3f-4625-9908-08c39a97bbe8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:24.163988 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-136843e5-2c3f-4625-9908-08c39a97bbe8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1673 microversion: 2.1 time: 0.150504 May 13 13:30:24.164559 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 361/699] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:24 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:24.298110 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2ac4a0d2-65c7-4bba-8426-89f25c9413b6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:24.298655 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2ac4a0d2-65c7-4bba-8426-89f25c9413b6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:24.304609 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2ac4a0d2-65c7-4bba-8426-89f25c9413b6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:24.305073 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2ac4a0d2-65c7-4bba-8426-89f25c9413b6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:24.305876 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2ac4a0d2-65c7-4bba-8426-89f25c9413b6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:24.306317 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2ac4a0d2-65c7-4bba-8426-89f25c9413b6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:24.454377 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2ac4a0d2-65c7-4bba-8426-89f25c9413b6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:24.462190 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2ac4a0d2-65c7-4bba-8426-89f25c9413b6 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.168909 May 13 13:30:24.462756 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 339/700] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:24 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:25.277604 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-249ebfff-0f0a-41b1-8bb6-0696a252f3a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:25.278293 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-249ebfff-0f0a-41b1-8bb6-0696a252f3a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:25.284781 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-249ebfff-0f0a-41b1-8bb6-0696a252f3a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:25.285230 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-249ebfff-0f0a-41b1-8bb6-0696a252f3a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:25.286067 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-249ebfff-0f0a-41b1-8bb6-0696a252f3a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:25.286504 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-249ebfff-0f0a-41b1-8bb6-0696a252f3a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:25.417417 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-249ebfff-0f0a-41b1-8bb6-0696a252f3a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:25.424837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-249ebfff-0f0a-41b1-8bb6-0696a252f3a7 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1673 microversion: 2.1 time: 0.248319 May 13 13:30:25.425403 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 362/701] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:25 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1673 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:25.479020 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-64ae13a9-8eba-4a3a-99df-2a99eeb342a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:25.479441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-64ae13a9-8eba-4a3a-99df-2a99eeb342a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:25.485769 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-64ae13a9-8eba-4a3a-99df-2a99eeb342a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:25.486254 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-64ae13a9-8eba-4a3a-99df-2a99eeb342a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:25.487036 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-64ae13a9-8eba-4a3a-99df-2a99eeb342a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:25.487473 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-64ae13a9-8eba-4a3a-99df-2a99eeb342a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:25.630267 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-64ae13a9-8eba-4a3a-99df-2a99eeb342a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:25.638369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-64ae13a9-8eba-4a3a-99df-2a99eeb342a7 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.163409 May 13 13:30:25.638943 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 340/702] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:25 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:26.442086 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c14699f1-e1f8-412d-9a3e-f816a59211e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:26.442736 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c14699f1-e1f8-412d-9a3e-f816a59211e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:26.449175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c14699f1-e1f8-412d-9a3e-f816a59211e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:26.449635 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c14699f1-e1f8-412d-9a3e-f816a59211e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:26.450445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c14699f1-e1f8-412d-9a3e-f816a59211e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:26.450895 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c14699f1-e1f8-412d-9a3e-f816a59211e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:26.592330 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c14699f1-e1f8-412d-9a3e-f816a59211e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:26.599923 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c14699f1-e1f8-412d-9a3e-f816a59211e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1673 microversion: 2.1 time: 0.162300 May 13 13:30:26.600506 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 363/703] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:26 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:26.656396 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f88803ca-e41d-4fcc-8497-e62b528238bb tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:26.657030 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f88803ca-e41d-4fcc-8497-e62b528238bb tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:26.663536 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f88803ca-e41d-4fcc-8497-e62b528238bb tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:26.663984 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f88803ca-e41d-4fcc-8497-e62b528238bb tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:26.664748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f88803ca-e41d-4fcc-8497-e62b528238bb tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:26.665182 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f88803ca-e41d-4fcc-8497-e62b528238bb tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:26.814269 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f88803ca-e41d-4fcc-8497-e62b528238bb tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:26.823546 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f88803ca-e41d-4fcc-8497-e62b528238bb tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.170977 May 13 13:30:26.824292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 341/704] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:26 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:27.617670 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3758d7f2-3e4b-4599-ac3d-bf5acd5cb93f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:27.618388 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3758d7f2-3e4b-4599-ac3d-bf5acd5cb93f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:27.629303 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3758d7f2-3e4b-4599-ac3d-bf5acd5cb93f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.629682 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3758d7f2-3e4b-4599-ac3d-bf5acd5cb93f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.630525 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3758d7f2-3e4b-4599-ac3d-bf5acd5cb93f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.630957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3758d7f2-3e4b-4599-ac3d-bf5acd5cb93f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.748585 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3758d7f2-3e4b-4599-ac3d-bf5acd5cb93f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:27.757099 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3758d7f2-3e4b-4599-ac3d-bf5acd5cb93f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1606 microversion: 2.1 time: 0.143897 May 13 13:30:27.758333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 364/705] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:27 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1606 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:27.841763 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5d24e281-4f3a-4ddb-9d76-ed13c32534d8 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:27.842404 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-5d24e281-4f3a-4ddb-9d76-ed13c32534d8 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:27.849972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5d24e281-4f3a-4ddb-9d76-ed13c32534d8 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.855668 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5d24e281-4f3a-4ddb-9d76-ed13c32534d8 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:27.855668 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5d24e281-4f3a-4ddb-9d76-ed13c32534d8 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:27.855668 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5d24e281-4f3a-4ddb-9d76-ed13c32534d8 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:28.019321 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-5d24e281-4f3a-4ddb-9d76-ed13c32534d8 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:28.022966 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-d82ab426-db8d-4786-aa27-d34ce20a7a2e req-f8190f43-fd67-4891-9c73-fbd67b5a1bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f", "name": "network-vif-deleted", "tag": "14a7371d-78d5-4d51-b08a-8cd6ecaa1263"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:28.031469 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-d82ab426-db8d-4786-aa27-d34ce20a7a2e req-f8190f43-fd67-4891-9c73-fbd67b5a1bc0 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:28.032162 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-d82ab426-db8d-4786-aa27-d34ce20a7a2e req-f8190f43-fd67-4891-9c73-fbd67b5a1bc0 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:28.033630 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-5d24e281-4f3a-4ddb-9d76-ed13c32534d8 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.195647 May 13 13:30:28.043734 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-d82ab426-db8d-4786-aa27-d34ce20a7a2e req-f8190f43-fd67-4891-9c73-fbd67b5a1bc0 service nova] Creating event network-vif-deleted:14a7371d-78d5-4d51-b08a-8cd6ecaa1263 for instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f on hv-cinder-84159 May 13 13:30:28.053620 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 342/706] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:27 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:28.055032 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-d82ab426-db8d-4786-aa27-d34ce20a7a2e req-f8190f43-fd67-4891-9c73-fbd67b5a1bc0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035692 May 13 13:30:28.055626 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 365/707] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:28.779280 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7750001f-980e-4f4b-8c83-041e88bb52fd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:28.780078 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7750001f-980e-4f4b-8c83-041e88bb52fd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:28.786947 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7750001f-980e-4f4b-8c83-041e88bb52fd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:28.787653 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7750001f-980e-4f4b-8c83-041e88bb52fd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:28.788470 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7750001f-980e-4f4b-8c83-041e88bb52fd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:28.788912 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7750001f-980e-4f4b-8c83-041e88bb52fd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:28.821104 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7750001f-980e-4f4b-8c83-041e88bb52fd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:28.821561 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7750001f-980e-4f4b-8c83-041e88bb52fd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:28.822052 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-7750001f-980e-4f4b-8c83-041e88bb52fd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lazy-loading 'fault' on Instance uuid 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:30:28.886579 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-7750001f-980e-4f4b-8c83-041e88bb52fd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:28.895039 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7750001f-980e-4f4b-8c83-041e88bb52fd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 200 len: 1328 microversion: 2.1 time: 0.119766 May 13 13:30:28.895620 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 343/708] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:28 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:29.061164 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2074986e-a58b-46e7-a361-8146c0764962 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:29.061880 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2074986e-a58b-46e7-a361-8146c0764962 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:29.067971 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2074986e-a58b-46e7-a361-8146c0764962 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:29.068424 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2074986e-a58b-46e7-a361-8146c0764962 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:29.069187 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2074986e-a58b-46e7-a361-8146c0764962 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:29.069618 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2074986e-a58b-46e7-a361-8146c0764962 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:29.223097 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2074986e-a58b-46e7-a361-8146c0764962 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:29.231121 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2074986e-a58b-46e7-a361-8146c0764962 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.174659 May 13 13:30:29.231692 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 366/709] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:29 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:29.912643 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c543f1c5-67e8-46ba-9569-8283084a906d tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:29.913175 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c543f1c5-67e8-46ba-9569-8283084a906d tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:29.919715 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c543f1c5-67e8-46ba-9569-8283084a906d tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:29.920206 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c543f1c5-67e8-46ba-9569-8283084a906d tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:29.920994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c543f1c5-67e8-46ba-9569-8283084a906d tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:29.921439 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c543f1c5-67e8-46ba-9569-8283084a906d tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:29.935716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-c543f1c5-67e8-46ba-9569-8283084a906d tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] HTTP exception thrown: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c543f1c5-67e8-46ba-9569-8283084a906d tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Request method failure captured: May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f HTTP/1.1 May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflxDsrR31d-SIPD1D4egqJyf_jEs09f36p1mrqUfLT1xjmNSuYYzyE2vQ4C6DwTgEOSOnnkEC356p4RUfAO2l28KjPny4Rw_8RIFFB5LVj3w3gniM-a-g0rkXENFpzhgwelNJ4jja7MX52P9WxDDeZs9AjEoJQhEZAiivYDURiGU3YQ May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 915a7ff1f6d64480a08c38e762da4134 May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeTestJSON-961764179 May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:30:29.937438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:30:29.939124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_915a7ff1f6d64480a08c38e762da4134", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:30:29.939124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeTestJSON-961764179 May 13 13:30:29.939124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 915a7ff1f6d64480a08c38e762da4134 May 13 13:30:29.939124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeTestJSON-961764179 May 13 13:30:29.939124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeTestJSON-961764179-project May 13 13:30:29.939124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:30:29.939124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:30:29.939124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 233f5342cf334c7689cb9e71f4fbaab3 May 13 13:30:29.939124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeTestJSON-961764179-project May 13 13:30:29.939124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:30:29.939124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:30:29.939124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f'} May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:29.939938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:30:29.941161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:29.950722 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c543f1c5-67e8-46ba-9569-8283084a906d tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Returning 404 to user: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:29.950722 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c543f1c5-67e8-46ba-9569-8283084a906d tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 404 len: 111 microversion: 2.1 time: 0.030254 May 13 13:30:29.950722 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 344/710] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:29 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:30:29.950975 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-749d01d4-41c9-4d8f-a973-fbe33e790d91 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '.version_select at 0x7faaa1d87f70>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:30.039063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-749d01d4-41c9-4d8f-a973-fbe33e790d91 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155574201" status: 202 len: 0 microversion: 2.1 time: 0.094824 May 13 13:30:30.039828 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 367/711] 10.222.0.25 () {58 vars in 1220 bytes} [Fri May 13 13:30:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155574201 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:30:30.248565 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2ea44ea6-d519-46be-9f64-e7c472c799d5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:30.249190 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2ea44ea6-d519-46be-9f64-e7c472c799d5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:30.255055 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2ea44ea6-d519-46be-9f64-e7c472c799d5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:30.255502 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2ea44ea6-d519-46be-9f64-e7c472c799d5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:30.256258 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2ea44ea6-d519-46be-9f64-e7c472c799d5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:30.256690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2ea44ea6-d519-46be-9f64-e7c472c799d5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:30.411452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2ea44ea6-d519-46be-9f64-e7c472c799d5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:30.419100 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2ea44ea6-d519-46be-9f64-e7c472c799d5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.174458 May 13 13:30:30.419677 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 345/712] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:30 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:30.754748 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-950696c9-c885-4493-9b36-aa7d75c78d82 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:30.755291 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-950696c9-c885-4493-9b36-aa7d75c78d82 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:30.761971 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-950696c9-c885-4493-9b36-aa7d75c78d82 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:30.762406 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-950696c9-c885-4493-9b36-aa7d75c78d82 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:30.763191 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-950696c9-c885-4493-9b36-aa7d75c78d82 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:30.763634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-950696c9-c885-4493-9b36-aa7d75c78d82 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:30.859710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-950696c9-c885-4493-9b36-aa7d75c78d82 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lazy-loading 'services' on Instance uuid c8063f90-dde5-4697-b772-2d63abfae0ec {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:30:30.894068 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-19d75ab4-e5b7-4c63-b56b-abda07d56a2b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Action: 'create', calling method: .version_select at 0x7faaa1dce160>, body: {"keypair": {"name": "tempest-keypair-1040526730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+X6Y9MWSl4cW+wowT6gRlvAeODtnHgEsSYm/S+Cs12YeF0ydSu5k4SN4sccnWkZJ04mYQORofZ4/1+ulaRXk/eKtdfwvZjZCfCzWyCilrOso6NkMGFacZsLBFHI+QWZg=="}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:30.907690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-19d75ab4-e5b7-4c63-b56b-abda07d56a2b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Getting quotas for project 915a7ff1f6d64480a08c38e762da4134. Resources: {'key_pairs'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:30:30.911474 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-19d75ab4-e5b7-4c63-b56b-abda07d56a2b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Getting quotas for user 233f5342cf334c7689cb9e71f4fbaab3 and project 915a7ff1f6d64480a08c38e762da4134. Resources: {'key_pairs'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:30:31.016238 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-19d75ab4-e5b7-4c63-b56b-abda07d56a2b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126459 May 13 13:30:31.016867 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 346/713] 10.222.0.25 () {60 vars in 1158 bytes} [Fri May 13 13:30:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:30:31.116811 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-950696c9-c885-4493-9b36-aa7d75c78d82 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments/8105072d-3542-45d8-a219-b8b413d7e40a" status: 202 len: 0 microversion: 2.1 time: 0.366554 May 13 13:30:31.117405 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 368/714] 10.222.0.25 () {58 vars in 1415 bytes} [Fri May 13 13:30:30 2022] DELETE /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments/8105072d-3542-45d8-a219-b8b413d7e40a => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:30:31.127836 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9728250b-6f6b-47c0-a3d1-60e2064d04a7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:31.128808 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-9728250b-6f6b-47c0-a3d1-60e2064d04a7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:31.135309 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9728250b-6f6b-47c0-a3d1-60e2064d04a7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:31.135765 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9728250b-6f6b-47c0-a3d1-60e2064d04a7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:31.136549 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9728250b-6f6b-47c0-a3d1-60e2064d04a7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:31.136997 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9728250b-6f6b-47c0-a3d1-60e2064d04a7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:31.165449 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-9728250b-6f6b-47c0-a3d1-60e2064d04a7 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 May 13 13:30:31.166109 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 347/715] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:30:31 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:31.436835 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4c8fd0b3-e80d-4248-9721-3e99b13c0048 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:31.437530 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4c8fd0b3-e80d-4248-9721-3e99b13c0048 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:31.443681 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c8fd0b3-e80d-4248-9721-3e99b13c0048 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:31.444157 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c8fd0b3-e80d-4248-9721-3e99b13c0048 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:31.444926 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c8fd0b3-e80d-4248-9721-3e99b13c0048 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:31.445370 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4c8fd0b3-e80d-4248-9721-3e99b13c0048 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:31.618877 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4c8fd0b3-e80d-4248-9721-3e99b13c0048 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:31.626825 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4c8fd0b3-e80d-4248-9721-3e99b13c0048 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1753 microversion: 2.1 time: 0.194113 May 13 13:30:31.627409 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 369/716] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:31 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:32.176954 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f55352a6-dcce-4906-8629-aa1af6dd71df tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:32.177944 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f55352a6-dcce-4906-8629-aa1af6dd71df tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:32.184584 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f55352a6-dcce-4906-8629-aa1af6dd71df tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:32.185042 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f55352a6-dcce-4906-8629-aa1af6dd71df tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:32.185863 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f55352a6-dcce-4906-8629-aa1af6dd71df tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:32.186282 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f55352a6-dcce-4906-8629-aa1af6dd71df tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:32.217533 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f55352a6-dcce-4906-8629-aa1af6dd71df tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044647 May 13 13:30:32.218150 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 348/717] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:30:32 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:32.645775 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bd8b9d7f-b34b-4797-ac39-b32f161f6edd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:32.648884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bd8b9d7f-b34b-4797-ac39-b32f161f6edd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:32.654021 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bd8b9d7f-b34b-4797-ac39-b32f161f6edd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:32.654609 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bd8b9d7f-b34b-4797-ac39-b32f161f6edd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:32.655590 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bd8b9d7f-b34b-4797-ac39-b32f161f6edd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:32.656043 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bd8b9d7f-b34b-4797-ac39-b32f161f6edd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:32.893714 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bd8b9d7f-b34b-4797-ac39-b32f161f6edd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:32.901550 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bd8b9d7f-b34b-4797-ac39-b32f161f6edd tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1756 microversion: 2.1 time: 0.260890 May 13 13:30:32.902188 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 370/718] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:32 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1756 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:33.229187 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-de0d292a-3c60-4bb4-8645-2c20d4f14fd2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:33.230169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-de0d292a-3c60-4bb4-8645-2c20d4f14fd2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:33.236973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-de0d292a-3c60-4bb4-8645-2c20d4f14fd2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:33.237426 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-de0d292a-3c60-4bb4-8645-2c20d4f14fd2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:33.238241 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-de0d292a-3c60-4bb4-8645-2c20d4f14fd2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:33.238680 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-de0d292a-3c60-4bb4-8645-2c20d4f14fd2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:33.268813 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-de0d292a-3c60-4bb4-8645-2c20d4f14fd2 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 May 13 13:30:33.269372 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 349/719] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:30:33 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:33.848447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-647737005", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dceba3d8-accd-41b8-a33c-38f5d7f6c90b"}], "security_groups": [{"name": "tempest-securitygroup--1056265916"}], "key_name": "tempest-keypair-1040526730", "user_data": "}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:33.947218 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] validate_networks() for [('dceba3d8-accd-41b8-a33c-38f5d7f6c90b', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:30:34.280600 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f81a3121-c73e-49f7-8c34-38643a3ca3af tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:34.281538 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f81a3121-c73e-49f7-8c34-38643a3ca3af tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:34.288212 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f81a3121-c73e-49f7-8c34-38643a3ca3af tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:34.288785 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f81a3121-c73e-49f7-8c34-38643a3ca3af tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:34.289647 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f81a3121-c73e-49f7-8c34-38643a3ca3af tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:34.290229 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f81a3121-c73e-49f7-8c34-38643a3ca3af tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:34.322082 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f81a3121-c73e-49f7-8c34-38643a3ca3af tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045361 May 13 13:30:34.322659 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 350/720] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:30:34 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 13:30:34.398543 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6d260b05-7977-4cd1-88b3-9d625914d52b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:34.399039 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6d260b05-7977-4cd1-88b3-9d625914d52b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:34.401665 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:30:34.402175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:30:34.402661 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:30:34.403104 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:30:34.403526 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:30:34.405367 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6d260b05-7977-4cd1-88b3-9d625914d52b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:34.405938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6d260b05-7977-4cd1-88b3-9d625914d52b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:34.407283 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6d260b05-7977-4cd1-88b3-9d625914d52b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:34.407852 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6d260b05-7977-4cd1-88b3-9d625914d52b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:34.412786 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:34.413316 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:34.414238 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:34.414758 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:34.431781 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Getting quotas for project 915a7ff1f6d64480a08c38e762da4134. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:30:34.432938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6d260b05-7977-4cd1-88b3-9d625914d52b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Going to try to terminate instance {{(pid=117602) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:30:34.435874 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Getting quotas for user 233f5342cf334c7689cb9e71f4fbaab3 and project 915a7ff1f6d64480a08c38e762da4134. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:30:34.447296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:30:34.449696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:30:34.638517 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0a3c2440-84df-42c9-b03b-178fe4c39ef9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.794799 May 13 13:30:34.639170 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 371/721] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:30:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:30:34.648698 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c454295d-140e-4e48-a552-427ba76d746f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:34.649345 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c454295d-140e-4e48-a552-427ba76d746f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:34.702779 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c454295d-140e-4e48-a552-427ba76d746f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:34.712490 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c454295d-140e-4e48-a552-427ba76d746f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1237 microversion: 2.1 time: 0.067314 May 13 13:30:34.722443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 372/722] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:34 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:30:34.813720 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6d260b05-7977-4cd1-88b3-9d625914d52b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 204 len: 0 microversion: 2.1 time: 0.418770 May 13 13:30:34.817233 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 351/723] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:30:34 2022] DELETE /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 13:30:34.823532 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e86d1978-57ca-4adc-bb78-03f303223b45 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:34.824153 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e86d1978-57ca-4adc-bb78-03f303223b45 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:34.833312 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e86d1978-57ca-4adc-bb78-03f303223b45 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:34.833312 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e86d1978-57ca-4adc-bb78-03f303223b45 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:34.833312 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e86d1978-57ca-4adc-bb78-03f303223b45 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:34.833312 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e86d1978-57ca-4adc-bb78-03f303223b45 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:34.962025 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e86d1978-57ca-4adc-bb78-03f303223b45 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:34.969345 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e86d1978-57ca-4adc-bb78-03f303223b45 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1689 microversion: 2.1 time: 0.149521 May 13 13:30:34.969939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 373/724] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:34 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:35.730752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3332124f-36cb-42ca-93ee-6ff3124aef5c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:35.731422 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3332124f-36cb-42ca-93ee-6ff3124aef5c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:35.737739 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3332124f-36cb-42ca-93ee-6ff3124aef5c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:35.738227 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3332124f-36cb-42ca-93ee-6ff3124aef5c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:35.739002 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3332124f-36cb-42ca-93ee-6ff3124aef5c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:35.739447 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3332124f-36cb-42ca-93ee-6ff3124aef5c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:35.799986 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3332124f-36cb-42ca-93ee-6ff3124aef5c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:35.807195 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3332124f-36cb-42ca-93ee-6ff3124aef5c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1241 microversion: 2.1 time: 0.080734 May 13 13:30:35.807759 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 352/725] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:35 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:35.986472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5100cc58-a8a8-43bb-b762-dd79e56cffb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:35.987164 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5100cc58-a8a8-43bb-b762-dd79e56cffb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:35.993506 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5100cc58-a8a8-43bb-b762-dd79e56cffb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:35.994021 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5100cc58-a8a8-43bb-b762-dd79e56cffb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:35.994801 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5100cc58-a8a8-43bb-b762-dd79e56cffb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:35.995241 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5100cc58-a8a8-43bb-b762-dd79e56cffb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:36.125104 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5100cc58-a8a8-43bb-b762-dd79e56cffb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:36.132949 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5100cc58-a8a8-43bb-b762-dd79e56cffb6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1689 microversion: 2.1 time: 0.151029 May 13 13:30:36.133521 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 374/726] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:35 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:36.823850 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-422f28ff-ce54-405a-aae1-35bb8222f938 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:36.824468 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-422f28ff-ce54-405a-aae1-35bb8222f938 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:36.831696 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-422f28ff-ce54-405a-aae1-35bb8222f938 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:36.832163 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-422f28ff-ce54-405a-aae1-35bb8222f938 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:36.832966 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-422f28ff-ce54-405a-aae1-35bb8222f938 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:36.833410 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-422f28ff-ce54-405a-aae1-35bb8222f938 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:36.895644 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-422f28ff-ce54-405a-aae1-35bb8222f938 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:36.903082 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-422f28ff-ce54-405a-aae1-35bb8222f938 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1241 microversion: 2.1 time: 0.083114 May 13 13:30:36.903650 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 353/727] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:36 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:37.158579 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-548637a5-40ee-4e61-be9d-adeb744bc563 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:37.160015 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-548637a5-40ee-4e61-be9d-adeb744bc563 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:37.166843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-548637a5-40ee-4e61-be9d-adeb744bc563 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:37.167289 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-548637a5-40ee-4e61-be9d-adeb744bc563 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:37.168071 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-548637a5-40ee-4e61-be9d-adeb744bc563 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:37.168502 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-548637a5-40ee-4e61-be9d-adeb744bc563 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:37.301218 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-548637a5-40ee-4e61-be9d-adeb744bc563 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:37.308501 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-548637a5-40ee-4e61-be9d-adeb744bc563 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1689 microversion: 2.1 time: 0.161874 May 13 13:30:37.309066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 375/728] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:37 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:37.919023 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b0ee7a18-6c2d-45dc-a317-edffb9807a6c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:37.919668 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b0ee7a18-6c2d-45dc-a317-edffb9807a6c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:37.926144 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b0ee7a18-6c2d-45dc-a317-edffb9807a6c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:37.926602 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b0ee7a18-6c2d-45dc-a317-edffb9807a6c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:37.927374 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b0ee7a18-6c2d-45dc-a317-edffb9807a6c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:37.927854 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b0ee7a18-6c2d-45dc-a317-edffb9807a6c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:37.994654 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b0ee7a18-6c2d-45dc-a317-edffb9807a6c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:38.002147 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b0ee7a18-6c2d-45dc-a317-edffb9807a6c tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1241 microversion: 2.1 time: 0.087103 May 13 13:30:38.002710 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 354/729] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:37 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:38.325533 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b5828efa-fce9-4190-bef0-96170af7541d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:38.326145 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b5828efa-fce9-4190-bef0-96170af7541d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:38.333810 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5828efa-fce9-4190-bef0-96170af7541d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:38.334268 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5828efa-fce9-4190-bef0-96170af7541d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:38.335156 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5828efa-fce9-4190-bef0-96170af7541d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:38.335602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5828efa-fce9-4190-bef0-96170af7541d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:38.467793 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b5828efa-fce9-4190-bef0-96170af7541d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:38.475459 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b5828efa-fce9-4190-bef0-96170af7541d tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1689 microversion: 2.1 time: 0.153658 May 13 13:30:38.476036 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 376/730] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:38 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:39.019435 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-00959b69-d56c-4ddf-b827-ffe6ab2ba91e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:39.020048 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-00959b69-d56c-4ddf-b827-ffe6ab2ba91e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:39.026764 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-00959b69-d56c-4ddf-b827-ffe6ab2ba91e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:39.027336 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-00959b69-d56c-4ddf-b827-ffe6ab2ba91e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:39.028130 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-00959b69-d56c-4ddf-b827-ffe6ab2ba91e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:39.028571 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-00959b69-d56c-4ddf-b827-ffe6ab2ba91e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:39.092146 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-00959b69-d56c-4ddf-b827-ffe6ab2ba91e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:39.099512 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-00959b69-d56c-4ddf-b827-ffe6ab2ba91e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1241 microversion: 2.1 time: 0.084479 May 13 13:30:39.100417 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 355/731] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:39 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:39.491815 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1275191b-3852-4b75-92db-634385fc5ea6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:39.492534 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1275191b-3852-4b75-92db-634385fc5ea6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:39.500453 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1275191b-3852-4b75-92db-634385fc5ea6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:39.501032 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1275191b-3852-4b75-92db-634385fc5ea6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:39.501846 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1275191b-3852-4b75-92db-634385fc5ea6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:39.502290 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1275191b-3852-4b75-92db-634385fc5ea6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:39.683042 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1275191b-3852-4b75-92db-634385fc5ea6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:39.691122 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1275191b-3852-4b75-92db-634385fc5ea6 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1689 microversion: 2.1 time: 0.203222 May 13 13:30:39.691695 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 377/732] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:39 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1689 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:40.091303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-498dc2e2-319b-4371-9017-d28553912b0e req-50c19e5c-a912-4faf-b927-bbd67e016aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8063f90-dde5-4697-b772-2d63abfae0ec", "name": "network-vif-deleted", "tag": "ca45ea26-ebef-4cf1-b670-b108bd4e54d4"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:40.104102 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-498dc2e2-319b-4371-9017-d28553912b0e req-50c19e5c-a912-4faf-b927-bbd67e016aed service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:40.111914 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-498dc2e2-319b-4371-9017-d28553912b0e req-50c19e5c-a912-4faf-b927-bbd67e016aed service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:40.117343 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-237ce847-0bd0-4a05-bd9c-375357ccd17e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:40.118527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-237ce847-0bd0-4a05-bd9c-375357ccd17e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:40.131168 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-498dc2e2-319b-4371-9017-d28553912b0e req-50c19e5c-a912-4faf-b927-bbd67e016aed service nova] Creating event network-vif-deleted:ca45ea26-ebef-4cf1-b670-b108bd4e54d4 for instance c8063f90-dde5-4697-b772-2d63abfae0ec on hv-cinder-84159 May 13 13:30:40.132493 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-237ce847-0bd0-4a05-bd9c-375357ccd17e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:40.132984 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-237ce847-0bd0-4a05-bd9c-375357ccd17e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:40.134039 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-237ce847-0bd0-4a05-bd9c-375357ccd17e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:40.134560 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-237ce847-0bd0-4a05-bd9c-375357ccd17e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:40.137419 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-498dc2e2-319b-4371-9017-d28553912b0e req-50c19e5c-a912-4faf-b927-bbd67e016aed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049743 May 13 13:30:40.138608 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 356/733] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:40.241856 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-237ce847-0bd0-4a05-bd9c-375357ccd17e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:40.256783 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-237ce847-0bd0-4a05-bd9c-375357ccd17e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1297 microversion: 2.1 time: 0.143821 May 13 13:30:40.259956 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 378/734] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:40 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1297 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:30:40.710647 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d44ec662-131e-442d-a9fc-e9bc6bfba00a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:40.711715 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d44ec662-131e-442d-a9fc-e9bc6bfba00a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:40.718174 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d44ec662-131e-442d-a9fc-e9bc6bfba00a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:40.718754 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d44ec662-131e-442d-a9fc-e9bc6bfba00a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:40.720357 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d44ec662-131e-442d-a9fc-e9bc6bfba00a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:40.720890 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d44ec662-131e-442d-a9fc-e9bc6bfba00a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:40.755062 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d44ec662-131e-442d-a9fc-e9bc6bfba00a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:40.755347 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d44ec662-131e-442d-a9fc-e9bc6bfba00a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:40.755803 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-d44ec662-131e-442d-a9fc-e9bc6bfba00a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lazy-loading 'fault' on Instance uuid c8063f90-dde5-4697-b772-2d63abfae0ec {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:30:40.805063 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d44ec662-131e-442d-a9fc-e9bc6bfba00a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:40.812943 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d44ec662-131e-442d-a9fc-e9bc6bfba00a tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 200 len: 1335 microversion: 2.1 time: 0.107911 May 13 13:30:40.818352 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 357/735] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:40 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:41.276591 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-603c2c27-11c0-4457-b525-3ed0677c8f21 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:41.278058 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-603c2c27-11c0-4457-b525-3ed0677c8f21 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:41.284118 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-603c2c27-11c0-4457-b525-3ed0677c8f21 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:41.284899 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-603c2c27-11c0-4457-b525-3ed0677c8f21 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:41.285811 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-603c2c27-11c0-4457-b525-3ed0677c8f21 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:41.286205 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-603c2c27-11c0-4457-b525-3ed0677c8f21 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:41.431852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-603c2c27-11c0-4457-b525-3ed0677c8f21 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:41.440248 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-603c2c27-11c0-4457-b525-3ed0677c8f21 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1363 microversion: 2.1 time: 0.167507 May 13 13:30:41.440830 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 379/736] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:41 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:41.830804 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ceeb26b5-7490-4e3b-878a-7fbb7b143689 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:41.831523 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ceeb26b5-7490-4e3b-878a-7fbb7b143689 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: c8063f90-dde5-4697-b772-2d63abfae0ec] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:41.838110 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ceeb26b5-7490-4e3b-878a-7fbb7b143689 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:41.838565 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ceeb26b5-7490-4e3b-878a-7fbb7b143689 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:41.840262 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ceeb26b5-7490-4e3b-878a-7fbb7b143689 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:41.840901 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ceeb26b5-7490-4e3b-878a-7fbb7b143689 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:41.856076 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-ceeb26b5-7490-4e3b-878a-7fbb7b143689 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] HTTP exception thrown: Instance c8063f90-dde5-4697-b772-2d63abfae0ec could not be found. May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ceeb26b5-7490-4e3b-878a-7fbb7b143689 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Request method failure captured: May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec HTTP/1.1 May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflxCd_EoZAFYbTN-djoZynqAsA3N46ltWXN6ElWTHOeJzEEmWdor9xpEb-TN-9UOIjpjSWAAhgMGge4_A1Ww39JKwMQCj0YClHxuL6gKubHiyHfreieaD5jWE6gpoVXXhVTxV1jR6o9ep4G9hWBPrRMtkJorZmtfTBTb1K8oDMtHNwA May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: e25902914d244bfeaa038f24838c28ca May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:30:41.857748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:30:41.859408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e25902914d244bfeaa038f24838c28ca", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:30:41.859408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:30:41.859408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: e25902914d244bfeaa038f24838c28ca May 13 13:30:41.859408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:30:41.859408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-ServerRescueNegativeTestJSON-1596782097-project May 13 13:30:41.859408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:30:41.859408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:30:41.859408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: f56c908ada31445e85ec1dfee8e2ebdb May 13 13:30:41.859408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1596782097-project May 13 13:30:41.859408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:30:41.859408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance c8063f90-dde5-4697-b772-2d63abfae0ec could not be found. May 13 13:30:41.859408 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': 'c8063f90-dde5-4697-b772-2d63abfae0ec'} May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8063f90-dde5-4697-b772-2d63abfae0ec could not be found. May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:41.863673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8063f90-dde5-4697-b772-2d63abfae0ec could not be found. May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8063f90-dde5-4697-b772-2d63abfae0ec could not be found. May 13 13:30:41.865383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:41.867707 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ceeb26b5-7490-4e3b-878a-7fbb7b143689 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Returning 404 to user: Instance c8063f90-dde5-4697-b772-2d63abfae0ec could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:41.867707 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ceeb26b5-7490-4e3b-878a-7fbb7b143689 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec" status: 404 len: 111 microversion: 2.1 time: 0.033124 May 13 13:30:41.867707 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 358/737] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:41 2022] GET /compute/v2.1/servers/c8063f90-dde5-4697-b772-2d63abfae0ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:30:41.874228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6e2ebc81-fe4d-4377-9713-96e3a783c32b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '.version_select at 0x7faaa1d51310>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:41.992653 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6e2ebc81-fe4d-4377-9713-96e3a783c32b tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-696172800" status: 202 len: 0 microversion: 2.1 time: 0.122218 May 13 13:30:41.993170 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 380/738] 10.222.0.25 () {58 vars in 1217 bytes} [Fri May 13 13:30:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-696172800 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:30:42.176862 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-cff5dfc7-d58d-40c1-b3be-6d16b4d0e2ee req-efa52fac-df9a-43e3-96bc-67fe137d4262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a8fab2-8f7c-4abf-8c09-b09f33719545", "tag": "093f7cfd-0126-49c6-9c1c-b42a1adde880"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:42.185177 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-cff5dfc7-d58d-40c1-b3be-6d16b4d0e2ee req-efa52fac-df9a-43e3-96bc-67fe137d4262 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:42.185626 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-cff5dfc7-d58d-40c1-b3be-6d16b4d0e2ee req-efa52fac-df9a-43e3-96bc-67fe137d4262 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:42.207213 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-cff5dfc7-d58d-40c1-b3be-6d16b4d0e2ee req-efa52fac-df9a-43e3-96bc-67fe137d4262 service nova] Creating event network-changed:093f7cfd-0126-49c6-9c1c-b42a1adde880 for instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 on hv-cinder-84159 May 13 13:30:42.216784 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-cff5dfc7-d58d-40c1-b3be-6d16b4d0e2ee req-efa52fac-df9a-43e3-96bc-67fe137d4262 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190858 May 13 13:30:42.220806 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 359/739] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:42.457239 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-64b86f2c-a1df-4c6f-9348-bd8a7f1225cd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:42.458437 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-64b86f2c-a1df-4c6f-9348-bd8a7f1225cd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:42.465085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64b86f2c-a1df-4c6f-9348-bd8a7f1225cd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:42.465538 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64b86f2c-a1df-4c6f-9348-bd8a7f1225cd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:42.466369 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64b86f2c-a1df-4c6f-9348-bd8a7f1225cd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:42.466809 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64b86f2c-a1df-4c6f-9348-bd8a7f1225cd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:42.891996 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-64b86f2c-a1df-4c6f-9348-bd8a7f1225cd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:42.899376 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-64b86f2c-a1df-4c6f-9348-bd8a7f1225cd tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1363 microversion: 2.1 time: 0.446710 May 13 13:30:42.899953 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 381/740] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:42 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:43.917015 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-06824211-3241-4ead-afb1-86ba7db16bfa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:43.917733 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-06824211-3241-4ead-afb1-86ba7db16bfa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:43.925434 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-06824211-3241-4ead-afb1-86ba7db16bfa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:43.925931 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-06824211-3241-4ead-afb1-86ba7db16bfa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:43.926724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-06824211-3241-4ead-afb1-86ba7db16bfa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:43.927167 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-06824211-3241-4ead-afb1-86ba7db16bfa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:44.140429 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-06824211-3241-4ead-afb1-86ba7db16bfa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:44.148635 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-06824211-3241-4ead-afb1-86ba7db16bfa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1363 microversion: 2.1 time: 0.235849 May 13 13:30:44.149208 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 360/741] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:43 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:45.164582 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-24c1fa3d-27fd-4aae-8646-3ddcf39ff241 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:45.165206 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-24c1fa3d-27fd-4aae-8646-3ddcf39ff241 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:45.171718 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24c1fa3d-27fd-4aae-8646-3ddcf39ff241 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:45.172179 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24c1fa3d-27fd-4aae-8646-3ddcf39ff241 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:45.172962 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24c1fa3d-27fd-4aae-8646-3ddcf39ff241 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:45.173406 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-24c1fa3d-27fd-4aae-8646-3ddcf39ff241 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:45.300856 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-24c1fa3d-27fd-4aae-8646-3ddcf39ff241 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:45.308280 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-24c1fa3d-27fd-4aae-8646-3ddcf39ff241 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1363 microversion: 2.1 time: 0.147526 May 13 13:30:45.308855 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 382/742] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:45 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:45.637035 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-72471a3a-2f53-4f5b-8f24-3182d28416c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:45.637609 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-72471a3a-2f53-4f5b-8f24-3182d28416c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:45.643970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-72471a3a-2f53-4f5b-8f24-3182d28416c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:45.644427 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-72471a3a-2f53-4f5b-8f24-3182d28416c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:45.645202 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-72471a3a-2f53-4f5b-8f24-3182d28416c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:45.645643 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-72471a3a-2f53-4f5b-8f24-3182d28416c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:45.670631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-72471a3a-2f53-4f5b-8f24-3182d28416c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Going to try to terminate instance {{(pid=117602) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:30:46.059861 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-72471a3a-2f53-4f5b-8f24-3182d28416c8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "DELETE /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 204 len: 0 microversion: 2.1 time: 0.426305 May 13 13:30:46.060458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 361/743] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:30:45 2022] DELETE /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:30:46.068572 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-71281024-49c6-4e50-9037-f9bfc35fdcf8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:46.069333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-71281024-49c6-4e50-9037-f9bfc35fdcf8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:46.075294 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-71281024-49c6-4e50-9037-f9bfc35fdcf8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:46.080046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-71281024-49c6-4e50-9037-f9bfc35fdcf8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:46.080046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-71281024-49c6-4e50-9037-f9bfc35fdcf8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:46.080046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-71281024-49c6-4e50-9037-f9bfc35fdcf8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:46.218353 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-71281024-49c6-4e50-9037-f9bfc35fdcf8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:46.226435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-71281024-49c6-4e50-9037-f9bfc35fdcf8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1506 microversion: 2.1 time: 0.161659 May 13 13:30:46.227012 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 383/744] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:46 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:46.326139 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-10a5c5ea-5574-4d7c-a185-682530326e9a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:46.326835 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-10a5c5ea-5574-4d7c-a185-682530326e9a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:46.333505 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-10a5c5ea-5574-4d7c-a185-682530326e9a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:46.333999 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-10a5c5ea-5574-4d7c-a185-682530326e9a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:46.334774 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-10a5c5ea-5574-4d7c-a185-682530326e9a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:46.335212 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-10a5c5ea-5574-4d7c-a185-682530326e9a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:46.464330 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-10a5c5ea-5574-4d7c-a185-682530326e9a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:46.472171 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-10a5c5ea-5574-4d7c-a185-682530326e9a tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1363 microversion: 2.1 time: 0.150254 May 13 13:30:46.472751 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 362/745] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:46 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:47.105419 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-8cc0dda7-50d2-46ef-8ace-287afbee63fa req-f3c37feb-a272-4c62-9eeb-efd685192fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a8fab2-8f7c-4abf-8c09-b09f33719545", "name": "network-vif-plugged", "status": "completed", "tag": "093f7cfd-0126-49c6-9c1c-b42a1adde880"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:47.113444 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-8cc0dda7-50d2-46ef-8ace-287afbee63fa req-f3c37feb-a272-4c62-9eeb-efd685192fa1 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:47.113874 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-8cc0dda7-50d2-46ef-8ace-287afbee63fa req-f3c37feb-a272-4c62-9eeb-efd685192fa1 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:47.126020 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-8cc0dda7-50d2-46ef-8ace-287afbee63fa req-f3c37feb-a272-4c62-9eeb-efd685192fa1 service nova] Creating event network-vif-plugged:093f7cfd-0126-49c6-9c1c-b42a1adde880 for instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 on hv-cinder-84159 May 13 13:30:47.131111 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-8cc0dda7-50d2-46ef-8ace-287afbee63fa req-f3c37feb-a272-4c62-9eeb-efd685192fa1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029723 May 13 13:30:47.134979 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 384/746] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:47.243971 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c0031052-91ac-4672-8454-a7f2b8563ebf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:47.244595 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c0031052-91ac-4672-8454-a7f2b8563ebf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:47.251889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c0031052-91ac-4672-8454-a7f2b8563ebf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:47.252330 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c0031052-91ac-4672-8454-a7f2b8563ebf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:47.253120 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c0031052-91ac-4672-8454-a7f2b8563ebf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:47.253572 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c0031052-91ac-4672-8454-a7f2b8563ebf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:47.390597 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c0031052-91ac-4672-8454-a7f2b8563ebf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:47.401488 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c0031052-91ac-4672-8454-a7f2b8563ebf tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1506 microversion: 2.1 time: 0.158613 May 13 13:30:47.401488 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 363/747] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:47 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:47.489363 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ebc9cab9-d267-4f42-8655-c47752854de2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:47.490105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ebc9cab9-d267-4f42-8655-c47752854de2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:47.496643 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebc9cab9-d267-4f42-8655-c47752854de2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:47.497090 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebc9cab9-d267-4f42-8655-c47752854de2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:47.497882 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebc9cab9-d267-4f42-8655-c47752854de2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:47.498319 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebc9cab9-d267-4f42-8655-c47752854de2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:47.628586 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ebc9cab9-d267-4f42-8655-c47752854de2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:47.635823 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ebc9cab9-d267-4f42-8655-c47752854de2 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1363 microversion: 2.1 time: 0.151116 May 13 13:30:47.636380 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 385/748] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:47 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:48.415937 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-30153704-2fcc-4b12-9e20-5f036962fb3e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:48.416625 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-30153704-2fcc-4b12-9e20-5f036962fb3e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:48.423499 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-30153704-2fcc-4b12-9e20-5f036962fb3e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:48.423947 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-30153704-2fcc-4b12-9e20-5f036962fb3e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:48.424712 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-30153704-2fcc-4b12-9e20-5f036962fb3e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:48.425147 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-30153704-2fcc-4b12-9e20-5f036962fb3e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:48.564122 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-30153704-2fcc-4b12-9e20-5f036962fb3e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:48.572361 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-30153704-2fcc-4b12-9e20-5f036962fb3e tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1506 microversion: 2.1 time: 0.160701 May 13 13:30:48.582544 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 364/749] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:48 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:48.654358 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3de82571-e7dc-4ad6-a167-b99681846e27 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:48.658592 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3de82571-e7dc-4ad6-a167-b99681846e27 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:48.660522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-e4de504b-ed95-4b17-a4f8-75f1b12d9139 req-38507edb-2cab-470b-848c-7f7065c8f8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "579ddd42-b56b-41a6-bf6b-601e7b699383", "name": "network-vif-deleted", "tag": "56e2bb82-a229-4ab7-b089-0f87dc512a77"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:48.666138 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3de82571-e7dc-4ad6-a167-b99681846e27 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:48.666795 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3de82571-e7dc-4ad6-a167-b99681846e27 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:48.667784 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3de82571-e7dc-4ad6-a167-b99681846e27 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:48.668226 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3de82571-e7dc-4ad6-a167-b99681846e27 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:48.668533 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-e4de504b-ed95-4b17-a4f8-75f1b12d9139 req-38507edb-2cab-470b-848c-7f7065c8f8b2 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:48.669021 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-e4de504b-ed95-4b17-a4f8-75f1b12d9139 req-38507edb-2cab-470b-848c-7f7065c8f8b2 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:48.680448 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-e4de504b-ed95-4b17-a4f8-75f1b12d9139 req-38507edb-2cab-470b-848c-7f7065c8f8b2 service nova] Creating event network-vif-deleted:56e2bb82-a229-4ab7-b089-0f87dc512a77 for instance 579ddd42-b56b-41a6-bf6b-601e7b699383 on hv-cinder-84159 May 13 13:30:48.685119 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-e4de504b-ed95-4b17-a4f8-75f1b12d9139 req-38507edb-2cab-470b-848c-7f7065c8f8b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088753 May 13 13:30:48.685712 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 386/750] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:30:48.797858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3de82571-e7dc-4ad6-a167-b99681846e27 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:48.805022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3de82571-e7dc-4ad6-a167-b99681846e27 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1363 microversion: 2.1 time: 0.154976 May 13 13:30:48.805594 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 365/751] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:48 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:30:49.461299 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-90a08c34-e85e-4ba2-b602-bc0326b66fcc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:49.461934 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-90a08c34-e85e-4ba2-b602-bc0326b66fcc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:49.468020 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-90a08c34-e85e-4ba2-b602-bc0326b66fcc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:49.468470 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-90a08c34-e85e-4ba2-b602-bc0326b66fcc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:49.469268 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-90a08c34-e85e-4ba2-b602-bc0326b66fcc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:49.469708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-90a08c34-e85e-4ba2-b602-bc0326b66fcc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:49.493733 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-90a08c34-e85e-4ba2-b602-bc0326b66fcc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/ips" status: 200 len: 153 microversion: 2.20 time: 0.134369 May 13 13:30:49.494422 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 387/752] 10.222.0.25 () {60 vars in 1288 bytes} [Fri May 13 13:30:49 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/ips => generated 153 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:30:49.591789 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-fa453276-16f6-40be-b381-7aaec0d9b07c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:49.592398 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-fa453276-16f6-40be-b381-7aaec0d9b07c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:49.598551 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa453276-16f6-40be-b381-7aaec0d9b07c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:49.599000 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa453276-16f6-40be-b381-7aaec0d9b07c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:49.599768 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa453276-16f6-40be-b381-7aaec0d9b07c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:49.600204 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa453276-16f6-40be-b381-7aaec0d9b07c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:49.630930 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa453276-16f6-40be-b381-7aaec0d9b07c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:49.631302 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa453276-16f6-40be-b381-7aaec0d9b07c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:49.631744 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-fa453276-16f6-40be-b381-7aaec0d9b07c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lazy-loading 'fault' on Instance uuid 579ddd42-b56b-41a6-bf6b-601e7b699383 {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:30:49.670859 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-fa453276-16f6-40be-b381-7aaec0d9b07c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:49.678595 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-fa453276-16f6-40be-b381-7aaec0d9b07c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 200 len: 1311 microversion: 2.1 time: 0.092452 May 13 13:30:49.679149 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 366/753] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:49 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:49.821572 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a31792ce-045b-455e-8a72-10a62cc02f31 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:49.822357 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a31792ce-045b-455e-8a72-10a62cc02f31 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:49.828560 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a31792ce-045b-455e-8a72-10a62cc02f31 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:49.831264 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a31792ce-045b-455e-8a72-10a62cc02f31 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:49.831264 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a31792ce-045b-455e-8a72-10a62cc02f31 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:49.831264 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a31792ce-045b-455e-8a72-10a62cc02f31 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:49.963986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a31792ce-045b-455e-8a72-10a62cc02f31 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:49.973225 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a31792ce-045b-455e-8a72-10a62cc02f31 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1363 microversion: 2.1 time: 0.154894 May 13 13:30:49.973958 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 388/754] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:49 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:50.695132 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a8e53e45-0ba6-4a1f-9119-4099dbd915f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:50.695898 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a8e53e45-0ba6-4a1f-9119-4099dbd915f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: 579ddd42-b56b-41a6-bf6b-601e7b699383] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:50.702413 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8e53e45-0ba6-4a1f-9119-4099dbd915f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:50.702869 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8e53e45-0ba6-4a1f-9119-4099dbd915f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:50.703647 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8e53e45-0ba6-4a1f-9119-4099dbd915f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:50.704090 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8e53e45-0ba6-4a1f-9119-4099dbd915f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:50.717506 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-a8e53e45-0ba6-4a1f-9119-4099dbd915f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] HTTP exception thrown: Instance 579ddd42-b56b-41a6-bf6b-601e7b699383 could not be found. May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a8e53e45-0ba6-4a1f-9119-4099dbd915f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Request method failure captured: May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 HTTP/1.1 May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflxCd_EoZAFYbTN-djoZynqAsA3N46ltWXN6ElWTHOeJzEEmWdor9xpEb-TN-9UOIjpjSWAAhgMGge4_A1Ww39JKwMQCj0YClHxuL6gKubHiyHfreieaD5jWE6gpoVXXhVTxV1jR6o9ep4G9hWBPrRMtkJorZmtfTBTb1K8oDMtHNwA May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: e25902914d244bfeaa038f24838c28ca May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:30:50.719693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:30:50.721368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e25902914d244bfeaa038f24838c28ca", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:30:50.721368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:30:50.721368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: e25902914d244bfeaa038f24838c28ca May 13 13:30:50.721368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:30:50.721368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-ServerRescueNegativeTestJSON-1596782097-project May 13 13:30:50.721368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:30:50.721368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:30:50.721368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: f56c908ada31445e85ec1dfee8e2ebdb May 13 13:30:50.721368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1596782097-project May 13 13:30:50.721368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:30:50.721368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 579ddd42-b56b-41a6-bf6b-601e7b699383 could not be found. May 13 13:30:50.721368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '579ddd42-b56b-41a6-bf6b-601e7b699383'} May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 579ddd42-b56b-41a6-bf6b-601e7b699383 could not be found. May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:50.722249 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 579ddd42-b56b-41a6-bf6b-601e7b699383 could not be found. May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 579ddd42-b56b-41a6-bf6b-601e7b699383 could not be found. May 13 13:30:50.723489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:30:50.724592 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a8e53e45-0ba6-4a1f-9119-4099dbd915f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Returning 404 to user: Instance 579ddd42-b56b-41a6-bf6b-601e7b699383 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:50.724592 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a8e53e45-0ba6-4a1f-9119-4099dbd915f3 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383" status: 404 len: 111 microversion: 2.1 time: 0.029901 May 13 13:30:50.724592 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 367/755] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:50 2022] GET /compute/v2.1/servers/579ddd42-b56b-41a6-bf6b-601e7b699383 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:30:50.729817 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3b221668-0683-4c05-b405-2d30bc9f3892 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:50.730180 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3b221668-0683-4c05-b405-2d30bc9f3892 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:50.737638 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b221668-0683-4c05-b405-2d30bc9f3892 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:50.738391 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b221668-0683-4c05-b405-2d30bc9f3892 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:50.738875 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b221668-0683-4c05-b405-2d30bc9f3892 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:50.739310 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3b221668-0683-4c05-b405-2d30bc9f3892 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:50.763751 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3b221668-0683-4c05-b405-2d30bc9f3892 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:30:50.989727 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-613c6b87-b89a-44bf-9f7f-cce5d380ffa8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:50.990368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-613c6b87-b89a-44bf-9f7f-cce5d380ffa8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:50.996292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-613c6b87-b89a-44bf-9f7f-cce5d380ffa8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:50.996743 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-613c6b87-b89a-44bf-9f7f-cce5d380ffa8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:50.997517 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-613c6b87-b89a-44bf-9f7f-cce5d380ffa8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:50.997988 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-613c6b87-b89a-44bf-9f7f-cce5d380ffa8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:51.129110 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-613c6b87-b89a-44bf-9f7f-cce5d380ffa8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:51.133990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3b221668-0683-4c05-b405-2d30bc9f3892 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 204 len: 0 microversion: 2.1 time: 0.407913 May 13 13:30:51.135288 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 389/756] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:30:50 2022] DELETE /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:30:51.137327 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-613c6b87-b89a-44bf-9f7f-cce5d380ffa8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1548 microversion: 2.1 time: 0.151509 May 13 13:30:51.137913 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 368/757] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:50 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:30:51.145018 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-87743273-152a-4c4d-8427-89786cc71df8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:51.145018 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-87743273-152a-4c4d-8427-89786cc71df8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:51.152216 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-87743273-152a-4c4d-8427-89786cc71df8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:51.152677 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-87743273-152a-4c4d-8427-89786cc71df8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:51.153977 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-87743273-152a-4c4d-8427-89786cc71df8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:51.154526 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-87743273-152a-4c4d-8427-89786cc71df8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:51.159639 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b2b1b313-fd3f-4102-bd0b-14bb3bd824cf tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:51.160137 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b2b1b313-fd3f-4102-bd0b-14bb3bd824cf tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:51.166930 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b2b1b313-fd3f-4102-bd0b-14bb3bd824cf tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:51.173857 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b2b1b313-fd3f-4102-bd0b-14bb3bd824cf tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:51.173857 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b2b1b313-fd3f-4102-bd0b-14bb3bd824cf tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:51.173857 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b2b1b313-fd3f-4102-bd0b-14bb3bd824cf tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:51.247758 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b2b1b313-fd3f-4102-bd0b-14bb3bd824cf tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092025 May 13 13:30:51.248356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 369/758] 10.222.0.25 () {58 vars in 1274 bytes} [Fri May 13 13:30:51 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:30:51.292439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-87743273-152a-4c4d-8427-89786cc71df8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:51.301336 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-87743273-152a-4c4d-8427-89786cc71df8 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.161058 May 13 13:30:51.302167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 390/759] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:51 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:30:52.273759 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-657f48a8-b871-4b1a-ba34-1ddeab55692c req-9505f488-01f3-4444-adee-752944f1795b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a8fab2-8f7c-4abf-8c09-b09f33719545", "tag": "093f7cfd-0126-49c6-9c1c-b42a1adde880"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:52.282376 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-657f48a8-b871-4b1a-ba34-1ddeab55692c req-9505f488-01f3-4444-adee-752944f1795b service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:52.283064 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-657f48a8-b871-4b1a-ba34-1ddeab55692c req-9505f488-01f3-4444-adee-752944f1795b service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:52.294137 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-657f48a8-b871-4b1a-ba34-1ddeab55692c req-9505f488-01f3-4444-adee-752944f1795b service nova] Creating event network-changed:093f7cfd-0126-49c6-9c1c-b42a1adde880 for instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 on hv-cinder-84159 May 13 13:30:52.299923 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-657f48a8-b871-4b1a-ba34-1ddeab55692c req-9505f488-01f3-4444-adee-752944f1795b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030414 May 13 13:30:52.300618 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 370/760] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:52.318433 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-15c9df34-b148-4c80-867d-5adcaf1acc0c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:52.319043 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-15c9df34-b148-4c80-867d-5adcaf1acc0c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:52.325623 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-15c9df34-b148-4c80-867d-5adcaf1acc0c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:52.333243 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-15c9df34-b148-4c80-867d-5adcaf1acc0c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:52.333243 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-15c9df34-b148-4c80-867d-5adcaf1acc0c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:52.333243 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-15c9df34-b148-4c80-867d-5adcaf1acc0c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:52.466940 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-15c9df34-b148-4c80-867d-5adcaf1acc0c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:52.474313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-15c9df34-b148-4c80-867d-5adcaf1acc0c tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.159702 May 13 13:30:52.475018 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 391/761] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:52 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:30:52.528088 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8d6610f1-4fad-4837-9519-5ad0e84b02af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:52.528717 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8d6610f1-4fad-4837-9519-5ad0e84b02af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:52.535393 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8d6610f1-4fad-4837-9519-5ad0e84b02af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:52.535846 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8d6610f1-4fad-4837-9519-5ad0e84b02af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:52.536639 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8d6610f1-4fad-4837-9519-5ad0e84b02af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:52.537097 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8d6610f1-4fad-4837-9519-5ad0e84b02af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:52.559038 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-8d6610f1-4fad-4837-9519-5ad0e84b02af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lazy-loading 'flavor' on Instance uuid 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:30:53.127283 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8d6610f1-4fad-4837-9519-5ad0e84b02af tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "POST /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/action" status: 202 len: 0 microversion: 2.20 time: 0.603551 May 13 13:30:53.128221 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 371/762] 10.222.0.25 () {62 vars in 1318 bytes} [Fri May 13 13:30:52 2022] POST /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:30:53.136382 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-75e88e75-bcc6-4735-a88a-bd8925c2f8df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:53.137069 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-75e88e75-bcc6-4735-a88a-bd8925c2f8df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:53.143993 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75e88e75-bcc6-4735-a88a-bd8925c2f8df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:53.149472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75e88e75-bcc6-4735-a88a-bd8925c2f8df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:53.149472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75e88e75-bcc6-4735-a88a-bd8925c2f8df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:53.149472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-75e88e75-bcc6-4735-a88a-bd8925c2f8df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:53.282687 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-75e88e75-bcc6-4735-a88a-bd8925c2f8df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:53.292451 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-75e88e75-bcc6-4735-a88a-bd8925c2f8df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:53.298670 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-75e88e75-bcc6-4735-a88a-bd8925c2f8df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:53.298670 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-75e88e75-bcc6-4735-a88a-bd8925c2f8df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.162807 May 13 13:30:53.298670 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 392/763] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:30:53 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:30:53.493459 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-cc75afa6-eaf4-4a78-92aa-6e7fea102624 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:53.494815 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-cc75afa6-eaf4-4a78-92aa-6e7fea102624 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:53.503415 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cc75afa6-eaf4-4a78-92aa-6e7fea102624 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:53.503882 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cc75afa6-eaf4-4a78-92aa-6e7fea102624 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:53.504681 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cc75afa6-eaf4-4a78-92aa-6e7fea102624 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:53.505124 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cc75afa6-eaf4-4a78-92aa-6e7fea102624 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:53.637714 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-cc75afa6-eaf4-4a78-92aa-6e7fea102624 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:53.646629 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-cc75afa6-eaf4-4a78-92aa-6e7fea102624 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.158420 May 13 13:30:53.647204 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 372/764] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:53 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:54.315975 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-395d5a4e-b3a3-42ea-8ee5-089cdb970cc9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:54.316624 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-395d5a4e-b3a3-42ea-8ee5-089cdb970cc9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:54.323182 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-395d5a4e-b3a3-42ea-8ee5-089cdb970cc9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:54.323643 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-395d5a4e-b3a3-42ea-8ee5-089cdb970cc9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:54.324425 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-395d5a4e-b3a3-42ea-8ee5-089cdb970cc9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:54.324945 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-395d5a4e-b3a3-42ea-8ee5-089cdb970cc9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:54.545526 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-395d5a4e-b3a3-42ea-8ee5-089cdb970cc9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:54.559303 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-395d5a4e-b3a3-42ea-8ee5-089cdb970cc9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:54.561584 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-395d5a4e-b3a3-42ea-8ee5-089cdb970cc9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:54.564805 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-395d5a4e-b3a3-42ea-8ee5-089cdb970cc9 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.253167 May 13 13:30:54.566717 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 393/765] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:30:54 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:30:54.664599 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-deff061b-9b32-4b9e-9982-9fcfdd7e56d5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:54.665855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-deff061b-9b32-4b9e-9982-9fcfdd7e56d5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:54.672383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-deff061b-9b32-4b9e-9982-9fcfdd7e56d5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:54.675067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-deff061b-9b32-4b9e-9982-9fcfdd7e56d5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:54.675871 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-deff061b-9b32-4b9e-9982-9fcfdd7e56d5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:54.676320 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-deff061b-9b32-4b9e-9982-9fcfdd7e56d5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:54.865322 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-deff061b-9b32-4b9e-9982-9fcfdd7e56d5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:54.873083 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-deff061b-9b32-4b9e-9982-9fcfdd7e56d5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1521 microversion: 2.1 time: 0.213228 May 13 13:30:54.873702 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 373/766] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:54 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:54.999962 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-f4e5526f-2942-493f-bbae-c19e83933258 req-53776081-726c-4c41-95b0-49b7b91b00ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f73c3e-c6fc-443b-a892-bf21c184de0c", "name": "network-vif-deleted", "tag": "7cb95faf-543f-4107-b4e6-b572ee1da4e2"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:30:55.008214 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-f4e5526f-2942-493f-bbae-c19e83933258 req-53776081-726c-4c41-95b0-49b7b91b00ff service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:55.008677 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-f4e5526f-2942-493f-bbae-c19e83933258 req-53776081-726c-4c41-95b0-49b7b91b00ff service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:55.020672 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-f4e5526f-2942-493f-bbae-c19e83933258 req-53776081-726c-4c41-95b0-49b7b91b00ff service nova] Creating event network-vif-deleted:7cb95faf-543f-4107-b4e6-b572ee1da4e2 for instance a1f73c3e-c6fc-443b-a892-bf21c184de0c on hv-cinder-84159 May 13 13:30:55.025642 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-f4e5526f-2942-493f-bbae-c19e83933258 req-53776081-726c-4c41-95b0-49b7b91b00ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029377 May 13 13:30:55.026276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 394/767] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:30:55.584019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-26f4f992-1dad-4e84-bd18-9ffa5522ab8d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:55.584725 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-26f4f992-1dad-4e84-bd18-9ffa5522ab8d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:55.590779 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-26f4f992-1dad-4e84-bd18-9ffa5522ab8d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:55.591232 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-26f4f992-1dad-4e84-bd18-9ffa5522ab8d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:55.592013 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-26f4f992-1dad-4e84-bd18-9ffa5522ab8d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:55.592449 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-26f4f992-1dad-4e84-bd18-9ffa5522ab8d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:55.734517 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-26f4f992-1dad-4e84-bd18-9ffa5522ab8d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:55.744577 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-26f4f992-1dad-4e84-bd18-9ffa5522ab8d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:55.746150 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-26f4f992-1dad-4e84-bd18-9ffa5522ab8d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:55.747323 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-26f4f992-1dad-4e84-bd18-9ffa5522ab8d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.167546 May 13 13:30:55.747915 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 374/768] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:30:55 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:30:55.894740 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-09bfffd2-a1c1-4654-a494-22eb871be135 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:55.894740 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-09bfffd2-a1c1-4654-a494-22eb871be135 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:55.897848 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09bfffd2-a1c1-4654-a494-22eb871be135 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:55.900246 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09bfffd2-a1c1-4654-a494-22eb871be135 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:55.901105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09bfffd2-a1c1-4654-a494-22eb871be135 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:55.901614 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09bfffd2-a1c1-4654-a494-22eb871be135 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:55.939273 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09bfffd2-a1c1-4654-a494-22eb871be135 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:55.939731 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-09bfffd2-a1c1-4654-a494-22eb871be135 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:55.940188 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-09bfffd2-a1c1-4654-a494-22eb871be135 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lazy-loading 'fault' on Instance uuid a1f73c3e-c6fc-443b-a892-bf21c184de0c {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:30:55.986551 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-09bfffd2-a1c1-4654-a494-22eb871be135 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f56c908ada31445e85ec1dfee8e2ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25902914d244bfeaa038f24838c28ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:55.994106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-09bfffd2-a1c1-4654-a494-22eb871be135 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 200 len: 1312 microversion: 2.1 time: 0.108101 May 13 13:30:55.994681 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 395/769] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:55 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:30:56.766329 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-506a2d3e-6eb8-482e-8112-bc1f8662c015 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:56.766940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-506a2d3e-6eb8-482e-8112-bc1f8662c015 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:56.773763 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-506a2d3e-6eb8-482e-8112-bc1f8662c015 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:56.774242 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-506a2d3e-6eb8-482e-8112-bc1f8662c015 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:56.775016 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-506a2d3e-6eb8-482e-8112-bc1f8662c015 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:56.775448 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-506a2d3e-6eb8-482e-8112-bc1f8662c015 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:56.912878 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-506a2d3e-6eb8-482e-8112-bc1f8662c015 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:56.920966 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-506a2d3e-6eb8-482e-8112-bc1f8662c015 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:56.923219 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-506a2d3e-6eb8-482e-8112-bc1f8662c015 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:56.924851 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-506a2d3e-6eb8-482e-8112-bc1f8662c015 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.162462 May 13 13:30:56.926083 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 375/770] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:30:56 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:30:57.011061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-505ac181-a4c8-4de9-830c-2c62fd84e9f5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:57.011682 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-505ac181-a4c8-4de9-830c-2c62fd84e9f5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] [instance: a1f73c3e-c6fc-443b-a892-bf21c184de0c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:57.018977 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-505ac181-a4c8-4de9-830c-2c62fd84e9f5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:57.019379 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-505ac181-a4c8-4de9-830c-2c62fd84e9f5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:57.020214 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-505ac181-a4c8-4de9-830c-2c62fd84e9f5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:57.020611 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-505ac181-a4c8-4de9-830c-2c62fd84e9f5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:57.034747 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-505ac181-a4c8-4de9-830c-2c62fd84e9f5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] HTTP exception thrown: Instance a1f73c3e-c6fc-443b-a892-bf21c184de0c could not be found. May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-505ac181-a4c8-4de9-830c-2c62fd84e9f5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Request method failure captured: May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c HTTP/1.1 May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflxCd_EoZAFYbTN-djoZynqAsA3N46ltWXN6ElWTHOeJzEEmWdor9xpEb-TN-9UOIjpjSWAAhgMGge4_A1Ww39JKwMQCj0YClHxuL6gKubHiyHfreieaD5jWE6gpoVXXhVTxV1jR6o9ep4G9hWBPrRMtkJorZmtfTBTb1K8oDMtHNwA May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: e25902914d244bfeaa038f24838c28ca May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:30:57.036387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:30:57.038010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_e25902914d244bfeaa038f24838c28ca", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/e25902914d244bfeaa038f24838c28ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:30:57.038010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:30:57.038010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: e25902914d244bfeaa038f24838c28ca May 13 13:30:57.038010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1596782097 May 13 13:30:57.038010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-ServerRescueNegativeTestJSON-1596782097-project May 13 13:30:57.038010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:30:57.038010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:30:57.038010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: f56c908ada31445e85ec1dfee8e2ebdb May 13 13:30:57.038010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1596782097-project May 13 13:30:57.038010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:30:57.038010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance a1f73c3e-c6fc-443b-a892-bf21c184de0c could not be found. May 13 13:30:57.038010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'a1f73c3e-c6fc-443b-a892-bf21c184de0c'} May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f73c3e-c6fc-443b-a892-bf21c184de0c could not be found. May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:30:57.038886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f73c3e-c6fc-443b-a892-bf21c184de0c could not be found. May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f73c3e-c6fc-443b-a892-bf21c184de0c could not be found. May 13 13:30:57.040333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:30:57.041680 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-505ac181-a4c8-4de9-830c-2c62fd84e9f5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] Returning 404 to user: Instance a1f73c3e-c6fc-443b-a892-bf21c184de0c could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:30:57.041680 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-505ac181-a4c8-4de9-830c-2c62fd84e9f5 tempest-ServerRescueNegativeTestJSON-1596782097 tempest-ServerRescueNegativeTestJSON-1596782097-project] 10.222.0.25 "GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c" status: 404 len: 111 microversion: 2.1 time: 0.030578 May 13 13:30:57.041680 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 396/771] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:30:57 2022] GET /compute/v2.1/servers/a1f73c3e-c6fc-443b-a892-bf21c184de0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:30:57.943712 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d63d7929-81d2-4a16-aecb-1d0e78e37a34 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:57.946383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d63d7929-81d2-4a16-aecb-1d0e78e37a34 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:57.956073 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d63d7929-81d2-4a16-aecb-1d0e78e37a34 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:57.956073 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d63d7929-81d2-4a16-aecb-1d0e78e37a34 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:57.956073 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d63d7929-81d2-4a16-aecb-1d0e78e37a34 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:57.956426 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d63d7929-81d2-4a16-aecb-1d0e78e37a34 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:58.166514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d63d7929-81d2-4a16-aecb-1d0e78e37a34 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:58.175173 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d63d7929-81d2-4a16-aecb-1d0e78e37a34 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:58.177263 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d63d7929-81d2-4a16-aecb-1d0e78e37a34 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:58.178716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d63d7929-81d2-4a16-aecb-1d0e78e37a34 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.239059 May 13 13:30:58.179874 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 376/772] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:30:57 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:30:59.200472 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-160e2ccc-ca43-4cc0-9247-469f59837c7e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:30:59.202080 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-160e2ccc-ca43-4cc0-9247-469f59837c7e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:30:59.212415 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-160e2ccc-ca43-4cc0-9247-469f59837c7e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:59.212880 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-160e2ccc-ca43-4cc0-9247-469f59837c7e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:59.213679 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-160e2ccc-ca43-4cc0-9247-469f59837c7e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:30:59.214154 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-160e2ccc-ca43-4cc0-9247-469f59837c7e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:30:59.437089 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-160e2ccc-ca43-4cc0-9247-469f59837c7e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:59.447415 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-160e2ccc-ca43-4cc0-9247-469f59837c7e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:59.452746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-160e2ccc-ca43-4cc0-9247-469f59837c7e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:30:59.452746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-160e2ccc-ca43-4cc0-9247-469f59837c7e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.253774 May 13 13:30:59.452746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 397/773] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:30:59 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:00.468611 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-efe28f9e-e31d-4c91-acbe-a829a4c7227a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:00.469235 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-efe28f9e-e31d-4c91-acbe-a829a4c7227a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:00.480031 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-efe28f9e-e31d-4c91-acbe-a829a4c7227a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:00.480697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-efe28f9e-e31d-4c91-acbe-a829a4c7227a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:00.481499 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-efe28f9e-e31d-4c91-acbe-a829a4c7227a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:00.481974 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-efe28f9e-e31d-4c91-acbe-a829a4c7227a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:00.616000 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-efe28f9e-e31d-4c91-acbe-a829a4c7227a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:00.623909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-efe28f9e-e31d-4c91-acbe-a829a4c7227a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:00.625938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-efe28f9e-e31d-4c91-acbe-a829a4c7227a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:00.627095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-efe28f9e-e31d-4c91-acbe-a829a4c7227a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.162455 May 13 13:31:00.627640 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 377/774] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:00 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:01.645138 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1666f14a-083c-4ad4-a6b8-71fbd4286f92 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:01.645693 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1666f14a-083c-4ad4-a6b8-71fbd4286f92 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:01.652391 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1666f14a-083c-4ad4-a6b8-71fbd4286f92 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:01.655785 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1666f14a-083c-4ad4-a6b8-71fbd4286f92 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:01.655785 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1666f14a-083c-4ad4-a6b8-71fbd4286f92 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:01.655785 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1666f14a-083c-4ad4-a6b8-71fbd4286f92 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:01.818755 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1666f14a-083c-4ad4-a6b8-71fbd4286f92 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:01.826958 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1666f14a-083c-4ad4-a6b8-71fbd4286f92 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:01.828450 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1666f14a-083c-4ad4-a6b8-71fbd4286f92 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:01.829624 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1666f14a-083c-4ad4-a6b8-71fbd4286f92 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.188600 May 13 13:31:01.830509 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 398/775] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:01 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:02.853385 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-01285af3-1369-46da-a417-c69a5351ab93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:02.854021 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-01285af3-1369-46da-a417-c69a5351ab93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:02.861115 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-01285af3-1369-46da-a417-c69a5351ab93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:02.861570 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-01285af3-1369-46da-a417-c69a5351ab93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:02.862533 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-01285af3-1369-46da-a417-c69a5351ab93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:02.862983 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-01285af3-1369-46da-a417-c69a5351ab93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:02.993656 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-01285af3-1369-46da-a417-c69a5351ab93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:03.001467 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-01285af3-1369-46da-a417-c69a5351ab93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:03.002988 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-01285af3-1369-46da-a417-c69a5351ab93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:03.004140 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-01285af3-1369-46da-a417-c69a5351ab93 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.155253 May 13 13:31:03.004690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 378/776] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:02 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:04.022158 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-222299e1-d749-44f4-95dc-45c24e2f3eb4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:04.023479 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-222299e1-d749-44f4-95dc-45c24e2f3eb4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:04.029838 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-222299e1-d749-44f4-95dc-45c24e2f3eb4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:04.030299 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-222299e1-d749-44f4-95dc-45c24e2f3eb4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:04.031090 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-222299e1-d749-44f4-95dc-45c24e2f3eb4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:04.031694 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-222299e1-d749-44f4-95dc-45c24e2f3eb4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:04.163620 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-222299e1-d749-44f4-95dc-45c24e2f3eb4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:04.171427 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-222299e1-d749-44f4-95dc-45c24e2f3eb4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:04.173570 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-222299e1-d749-44f4-95dc-45c24e2f3eb4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:04.174759 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-222299e1-d749-44f4-95dc-45c24e2f3eb4 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.156510 May 13 13:31:04.175325 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 399/777] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:04 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:05.193081 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d9615954-70d6-4e36-83cc-6dbf03bb3446 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:05.193778 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d9615954-70d6-4e36-83cc-6dbf03bb3446 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:05.200212 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d9615954-70d6-4e36-83cc-6dbf03bb3446 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:05.200770 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d9615954-70d6-4e36-83cc-6dbf03bb3446 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:05.201609 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d9615954-70d6-4e36-83cc-6dbf03bb3446 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:05.202138 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d9615954-70d6-4e36-83cc-6dbf03bb3446 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:05.458486 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d9615954-70d6-4e36-83cc-6dbf03bb3446 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:05.466835 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d9615954-70d6-4e36-83cc-6dbf03bb3446 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:05.468357 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d9615954-70d6-4e36-83cc-6dbf03bb3446 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:05.471035 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d9615954-70d6-4e36-83cc-6dbf03bb3446 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.280983 May 13 13:31:05.483350 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 379/778] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:05 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:06.488685 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-960fb2fa-f904-4295-ac1c-64f7c1001d46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:06.490249 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-960fb2fa-f904-4295-ac1c-64f7c1001d46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:06.498051 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-960fb2fa-f904-4295-ac1c-64f7c1001d46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:06.498892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-960fb2fa-f904-4295-ac1c-64f7c1001d46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:06.500112 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-960fb2fa-f904-4295-ac1c-64f7c1001d46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:06.501324 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-960fb2fa-f904-4295-ac1c-64f7c1001d46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:06.655534 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-960fb2fa-f904-4295-ac1c-64f7c1001d46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:06.664521 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-960fb2fa-f904-4295-ac1c-64f7c1001d46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:06.666040 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-960fb2fa-f904-4295-ac1c-64f7c1001d46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:06.667550 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-960fb2fa-f904-4295-ac1c-64f7c1001d46 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.182831 May 13 13:31:06.668117 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 400/779] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:06 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:07.686110 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ccfdaba4-06e6-451f-aea4-c102bdee25ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:07.686722 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ccfdaba4-06e6-451f-aea4-c102bdee25ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:07.693347 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ccfdaba4-06e6-451f-aea4-c102bdee25ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:07.694175 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ccfdaba4-06e6-451f-aea4-c102bdee25ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:07.694960 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ccfdaba4-06e6-451f-aea4-c102bdee25ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:07.695605 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ccfdaba4-06e6-451f-aea4-c102bdee25ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:07.828269 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ccfdaba4-06e6-451f-aea4-c102bdee25ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:07.837670 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ccfdaba4-06e6-451f-aea4-c102bdee25ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:07.839449 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ccfdaba4-06e6-451f-aea4-c102bdee25ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:07.840648 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ccfdaba4-06e6-451f-aea4-c102bdee25ec tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.158692 May 13 13:31:07.841584 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 380/780] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:07 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:08.860365 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-23fb86b8-6e6e-4615-996b-8ed5c0b74e0d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:08.861119 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-23fb86b8-6e6e-4615-996b-8ed5c0b74e0d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:08.867588 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23fb86b8-6e6e-4615-996b-8ed5c0b74e0d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:08.868059 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23fb86b8-6e6e-4615-996b-8ed5c0b74e0d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:08.868823 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23fb86b8-6e6e-4615-996b-8ed5c0b74e0d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:08.869257 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-23fb86b8-6e6e-4615-996b-8ed5c0b74e0d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:09.340624 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-23fb86b8-6e6e-4615-996b-8ed5c0b74e0d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:09.352712 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-23fb86b8-6e6e-4615-996b-8ed5c0b74e0d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:09.354360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-23fb86b8-6e6e-4615-996b-8ed5c0b74e0d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:09.357119 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-23fb86b8-6e6e-4615-996b-8ed5c0b74e0d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.500051 May 13 13:31:09.358338 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 401/781] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:08 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:09.764426 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6f4fdb38-08c2-4af4-8533-691f942cfb42 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: .version_select at 0x7faaa1bd1af0>, body: {"keypair": {"name": "tempest-keypair-267286585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOQbU8hJTXpdk9umHzWmCleYeEiPwWBApdLTeD7gyzyDWDonNGN+sFALCkDrJgi9V2MTJ7EMUowv26AyphmHnRxdUttg6G2FFULVe2isA8OTi/z5Z/208wStQMKhGRg5w=="}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:09.778409 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-6f4fdb38-08c2-4af4-8533-691f942cfb42 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for project 1e72f39546704606927bcefdc0f13235. Resources: {'key_pairs'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:31:09.782212 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-6f4fdb38-08c2-4af4-8533-691f942cfb42 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for user 79dbde2a65224927af4bb5e77090496c and project 1e72f39546704606927bcefdc0f13235. Resources: {'key_pairs'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:31:09.866932 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6f4fdb38-08c2-4af4-8533-691f942cfb42 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.213131 May 13 13:31:09.867529 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 381/782] 10.222.0.25 () {60 vars in 1158 bytes} [Fri May 13 13:31:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:10.375612 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9c907062-f80f-404d-8ca1-9227aff102a6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:10.376267 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9c907062-f80f-404d-8ca1-9227aff102a6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:10.385604 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9c907062-f80f-404d-8ca1-9227aff102a6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:10.391105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9c907062-f80f-404d-8ca1-9227aff102a6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:10.391105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9c907062-f80f-404d-8ca1-9227aff102a6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:10.391105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9c907062-f80f-404d-8ca1-9227aff102a6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:10.541163 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9c907062-f80f-404d-8ca1-9227aff102a6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:10.549891 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9c907062-f80f-404d-8ca1-9227aff102a6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:10.551328 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9c907062-f80f-404d-8ca1-9227aff102a6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:10.552484 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9c907062-f80f-404d-8ca1-9227aff102a6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.180817 May 13 13:31:10.553051 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 402/783] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:10 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:11.571295 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a0a2c691-1a37-4ea2-bcb4-68c984c13c19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:11.572267 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a0a2c691-1a37-4ea2-bcb4-68c984c13c19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:11.579565 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a0a2c691-1a37-4ea2-bcb4-68c984c13c19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:11.580024 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a0a2c691-1a37-4ea2-bcb4-68c984c13c19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:11.581060 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a0a2c691-1a37-4ea2-bcb4-68c984c13c19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:11.581505 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a0a2c691-1a37-4ea2-bcb4-68c984c13c19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:11.769670 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a0a2c691-1a37-4ea2-bcb4-68c984c13c19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:11.769670 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a0a2c691-1a37-4ea2-bcb4-68c984c13c19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:11.771691 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a0a2c691-1a37-4ea2-bcb4-68c984c13c19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:11.772911 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a0a2c691-1a37-4ea2-bcb4-68c984c13c19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.205743 May 13 13:31:11.783647 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 382/784] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:11 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:31:11.962856 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-993f5fbe-9359-45b4-abda-470ef14356ca tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-787756759"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:11.964006 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-993f5fbe-9359-45b4-abda-470ef14356ca tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:11.970220 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-993f5fbe-9359-45b4-abda-470ef14356ca tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:11.970680 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-993f5fbe-9359-45b4-abda-470ef14356ca tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:11.971635 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-993f5fbe-9359-45b4-abda-470ef14356ca tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:11.972026 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-993f5fbe-9359-45b4-abda-470ef14356ca tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:12.175962 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.network.security_group_api [None req-993f5fbe-9359-45b4-abda-470ef14356ca tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Removing security group a132708f-33d0-4e29-b377-a71de51115ec from port 77185538-d455-4ce8-942b-c0fc75b37ded May 13 13:31:12.654387 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-686541934", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46cd8800-6675-4b3d-a84e-b42f58021a8c"}], "security_groups": [{"name": "tempest-securitygroup--1913375024"}], "key_name": "tempest-keypair-267286585", "user_data": "}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:12.791683 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-993f5fbe-9359-45b4-abda-470ef14356ca tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "POST /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/action" status: 202 len: 0 microversion: 2.1 time: 0.832653 May 13 13:31:12.793137 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 403/785] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:31:11 2022] POST /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/action => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:31:12.793850 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.network.neutron [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] validate_networks() for [('46cd8800-6675-4b3d-a84e-b42f58021a8c', None, None, None, None, None)] {{(pid=117602) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:31:12.800260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-51bd4236-6a72-4474-a569-345700ced6dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:12.801690 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-51bd4236-6a72-4474-a569-345700ced6dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:12.816009 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-51bd4236-6a72-4474-a569-345700ced6dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:12.819201 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-51bd4236-6a72-4474-a569-345700ced6dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:12.820234 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-51bd4236-6a72-4474-a569-345700ced6dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:12.820853 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-51bd4236-6a72-4474-a569-345700ced6dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:13.121290 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-51bd4236-6a72-4474-a569-345700ced6dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:13.130210 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-51bd4236-6a72-4474-a569-345700ced6dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:13.134045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-51bd4236-6a72-4474-a569-345700ced6dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:13.139299 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-51bd4236-6a72-4474-a569-345700ced6dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.341136 May 13 13:31:13.139299 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 404/786] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:12 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:13.152822 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-89d532d8-5f6a-4069-8248-f0164e455a16 req-1fbaacd5-4e2d-4e10-8035-a44eeb78ee6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92bf6a17-fa9f-410e-b25d-4053de456900", "tag": "77185538-d455-4ce8-942b-c0fc75b37ded"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:13.170068 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-89d532d8-5f6a-4069-8248-f0164e455a16 req-1fbaacd5-4e2d-4e10-8035-a44eeb78ee6e service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:13.170784 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-89d532d8-5f6a-4069-8248-f0164e455a16 req-1fbaacd5-4e2d-4e10-8035-a44eeb78ee6e service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:13.187187 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-89d532d8-5f6a-4069-8248-f0164e455a16 req-1fbaacd5-4e2d-4e10-8035-a44eeb78ee6e service nova] Creating event network-changed:77185538-d455-4ce8-942b-c0fc75b37ded for instance 92bf6a17-fa9f-410e-b25d-4053de456900 on hv-cinder-84159 May 13 13:31:13.194284 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-89d532d8-5f6a-4069-8248-f0164e455a16 req-1fbaacd5-4e2d-4e10-8035-a44eeb78ee6e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055470 May 13 13:31:13.196445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 405/787] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:13.628341 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Flavor limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:31:13.628761 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Image limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:31:13.629231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Flavor pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:31:13.629633 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Image pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:31:13.630067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:31:13.638487 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:13.638935 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:13.639726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:13.640159 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:13.656328 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for project 1e72f39546704606927bcefdc0f13235. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:31:13.660436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for user 79dbde2a65224927af4bb5e77090496c and project 1e72f39546704606927bcefdc0f13235. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:31:13.672690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Going to run 1 instances... {{(pid=117602) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:31:13.675033 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:31:13.807485 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-84ff68f1-9932-4a97-b5b2-497a1bf83a43 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.158082 May 13 13:31:13.808460 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 383/788] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:31:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:31:13.819255 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a1627f0b-1fb0-4f3a-81f6-353eba8db7cd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:13.819989 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a1627f0b-1fb0-4f3a-81f6-353eba8db7cd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:13.881821 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a1627f0b-1fb0-4f3a-81f6-353eba8db7cd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:13.889923 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a1627f0b-1fb0-4f3a-81f6-353eba8db7cd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1240 microversion: 2.1 time: 0.074550 May 13 13:31:13.890488 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 406/789] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:13 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:14.154653 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-82b8df12-979e-48c7-bfe4-7bd5806bdd60 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:14.155301 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-82b8df12-979e-48c7-bfe4-7bd5806bdd60 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:14.162614 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-82b8df12-979e-48c7-bfe4-7bd5806bdd60 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:14.163070 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-82b8df12-979e-48c7-bfe4-7bd5806bdd60 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:14.163852 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-82b8df12-979e-48c7-bfe4-7bd5806bdd60 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:14.164290 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-82b8df12-979e-48c7-bfe4-7bd5806bdd60 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:14.459757 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-82b8df12-979e-48c7-bfe4-7bd5806bdd60 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:14.468137 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-82b8df12-979e-48c7-bfe4-7bd5806bdd60 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:14.470381 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-82b8df12-979e-48c7-bfe4-7bd5806bdd60 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:14.471561 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-82b8df12-979e-48c7-bfe4-7bd5806bdd60 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.320918 May 13 13:31:14.472164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 384/790] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:14 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:14.793566 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-14764fd1-fb38-4508-b642-c2c19949fddc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:14.794396 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-14764fd1-fb38-4508-b642-c2c19949fddc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:14.796336 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-e0bb64a7-f702-43c0-bbe4-094861aae303 req-3df2e6ee-4bff-4b79-81fc-7f0e7ef73b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92bf6a17-fa9f-410e-b25d-4053de456900", "tag": "77185538-d455-4ce8-942b-c0fc75b37ded"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:14.806123 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14764fd1-fb38-4508-b642-c2c19949fddc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:14.806583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14764fd1-fb38-4508-b642-c2c19949fddc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:14.806987 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-e0bb64a7-f702-43c0-bbe4-094861aae303 req-3df2e6ee-4bff-4b79-81fc-7f0e7ef73b61 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:14.807367 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14764fd1-fb38-4508-b642-c2c19949fddc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:14.807514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-e0bb64a7-f702-43c0-bbe4-094861aae303 req-3df2e6ee-4bff-4b79-81fc-7f0e7ef73b61 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:14.807847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-14764fd1-fb38-4508-b642-c2c19949fddc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:14.819957 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-e0bb64a7-f702-43c0-bbe4-094861aae303 req-3df2e6ee-4bff-4b79-81fc-7f0e7ef73b61 service nova] Creating event network-changed:77185538-d455-4ce8-942b-c0fc75b37ded for instance 92bf6a17-fa9f-410e-b25d-4053de456900 on hv-cinder-84159 May 13 13:31:14.825325 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-e0bb64a7-f702-43c0-bbe4-094861aae303 req-3df2e6ee-4bff-4b79-81fc-7f0e7ef73b61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032997 May 13 13:31:14.826341 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 385/791] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:31:14.908188 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-229d407b-8eac-4896-bc34-54ed2993d316 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:14.909202 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-229d407b-8eac-4896-bc34-54ed2993d316 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:14.920065 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-14764fd1-fb38-4508-b642-c2c19949fddc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lazy-loading 'services' on Instance uuid 92bf6a17-fa9f-410e-b25d-4053de456900 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:31:14.990776 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-229d407b-8eac-4896-bc34-54ed2993d316 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:14.998558 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-229d407b-8eac-4896-bc34-54ed2993d316 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1240 microversion: 2.1 time: 0.095092 May 13 13:31:14.999403 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 386/792] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:14 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:31:15.191457 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-14764fd1-fb38-4508-b642-c2c19949fddc tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments/36cbabf0-84ef-44b7-80fe-d43fc295534b" status: 202 len: 0 microversion: 2.1 time: 0.401342 May 13 13:31:15.192209 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 407/793] 10.222.0.25 () {58 vars in 1415 bytes} [Fri May 13 13:31:14 2022] DELETE /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments/36cbabf0-84ef-44b7-80fe-d43fc295534b => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:31:15.202737 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-89d30d8e-0b52-4a32-aede-c641691fb0b5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:15.207028 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-89d30d8e-0b52-4a32-aede-c641691fb0b5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:15.215606 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-89d30d8e-0b52-4a32-aede-c641691fb0b5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:15.216225 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-89d30d8e-0b52-4a32-aede-c641691fb0b5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:15.217252 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-89d30d8e-0b52-4a32-aede-c641691fb0b5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:15.217748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-89d30d8e-0b52-4a32-aede-c641691fb0b5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:15.257272 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-89d30d8e-0b52-4a32-aede-c641691fb0b5 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059348 May 13 13:31:15.258965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 387/794] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:31:15 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:15.490326 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-248c6333-2a36-45d6-b9c6-02710a7fe5dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:15.491120 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-248c6333-2a36-45d6-b9c6-02710a7fe5dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:15.497350 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-248c6333-2a36-45d6-b9c6-02710a7fe5dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:15.497810 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-248c6333-2a36-45d6-b9c6-02710a7fe5dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:15.498594 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-248c6333-2a36-45d6-b9c6-02710a7fe5dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:15.499025 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-248c6333-2a36-45d6-b9c6-02710a7fe5dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:15.656895 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-248c6333-2a36-45d6-b9c6-02710a7fe5dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:15.665819 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-248c6333-2a36-45d6-b9c6-02710a7fe5dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:15.667652 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-248c6333-2a36-45d6-b9c6-02710a7fe5dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:15.668784 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-248c6333-2a36-45d6-b9c6-02710a7fe5dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1747 microversion: 2.20 time: 0.182815 May 13 13:31:15.669354 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 408/795] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:15 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1747 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:16.016593 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-13a036d8-6808-4e8d-a17d-9a386c85aae6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:16.017835 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-13a036d8-6808-4e8d-a17d-9a386c85aae6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:16.024471 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-13a036d8-6808-4e8d-a17d-9a386c85aae6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:16.024926 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-13a036d8-6808-4e8d-a17d-9a386c85aae6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:16.025708 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-13a036d8-6808-4e8d-a17d-9a386c85aae6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:16.026178 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-13a036d8-6808-4e8d-a17d-9a386c85aae6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:16.096692 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-13a036d8-6808-4e8d-a17d-9a386c85aae6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:16.104918 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-13a036d8-6808-4e8d-a17d-9a386c85aae6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1292 microversion: 2.1 time: 0.092507 May 13 13:31:16.105828 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 388/796] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:16 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:16.271119 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d1bf7d84-c680-4dda-899c-33f0b731f5ae tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:16.272162 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d1bf7d84-c680-4dda-899c-33f0b731f5ae tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:16.279108 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d1bf7d84-c680-4dda-899c-33f0b731f5ae tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:16.279653 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d1bf7d84-c680-4dda-899c-33f0b731f5ae tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:16.280522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d1bf7d84-c680-4dda-899c-33f0b731f5ae tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:16.281135 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d1bf7d84-c680-4dda-899c-33f0b731f5ae tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:16.309278 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d1bf7d84-c680-4dda-899c-33f0b731f5ae tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043571 May 13 13:31:16.310636 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 409/797] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:31:16 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:16.687372 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-851c65fe-d347-4f05-bbd6-fdc1ec30f133 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:16.688553 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-851c65fe-d347-4f05-bbd6-fdc1ec30f133 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:16.694509 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-851c65fe-d347-4f05-bbd6-fdc1ec30f133 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:16.696797 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-851c65fe-d347-4f05-bbd6-fdc1ec30f133 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:16.696797 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-851c65fe-d347-4f05-bbd6-fdc1ec30f133 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:16.696797 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-851c65fe-d347-4f05-bbd6-fdc1ec30f133 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:16.837327 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-851c65fe-d347-4f05-bbd6-fdc1ec30f133 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:16.846451 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-851c65fe-d347-4f05-bbd6-fdc1ec30f133 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:16.847946 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-851c65fe-d347-4f05-bbd6-fdc1ec30f133 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:16.849118 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-851c65fe-d347-4f05-bbd6-fdc1ec30f133 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1747 microversion: 2.20 time: 0.165711 May 13 13:31:16.849676 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 389/798] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:16 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:17.122785 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9b5f12b4-49ad-4596-b432-fe16d9f8acb8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:17.123645 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9b5f12b4-49ad-4596-b432-fe16d9f8acb8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:17.130283 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9b5f12b4-49ad-4596-b432-fe16d9f8acb8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:17.130839 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9b5f12b4-49ad-4596-b432-fe16d9f8acb8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:17.131697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9b5f12b4-49ad-4596-b432-fe16d9f8acb8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:17.132696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9b5f12b4-49ad-4596-b432-fe16d9f8acb8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:17.210223 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9b5f12b4-49ad-4596-b432-fe16d9f8acb8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:17.217851 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9b5f12b4-49ad-4596-b432-fe16d9f8acb8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1298 microversion: 2.1 time: 0.098976 May 13 13:31:17.218511 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 410/799] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:17 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:17.324877 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a8823352-4443-44e4-9e62-a3f142a41ce1 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:17.324877 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a8823352-4443-44e4-9e62-a3f142a41ce1 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:17.329766 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8823352-4443-44e4-9e62-a3f142a41ce1 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:17.330751 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8823352-4443-44e4-9e62-a3f142a41ce1 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:17.331946 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8823352-4443-44e4-9e62-a3f142a41ce1 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:17.332568 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8823352-4443-44e4-9e62-a3f142a41ce1 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:17.374260 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a8823352-4443-44e4-9e62-a3f142a41ce1 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055599 May 13 13:31:17.374260 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 390/800] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:31:17 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:31:17.384777 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e0ad6d1b-d0f9-4d47-9ff2-28f52c15ad91 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:17.385278 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e0ad6d1b-d0f9-4d47-9ff2-28f52c15ad91 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:17.399502 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e0ad6d1b-d0f9-4d47-9ff2-28f52c15ad91 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:17.399956 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e0ad6d1b-d0f9-4d47-9ff2-28f52c15ad91 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:17.401017 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e0ad6d1b-d0f9-4d47-9ff2-28f52c15ad91 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:17.401496 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e0ad6d1b-d0f9-4d47-9ff2-28f52c15ad91 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:17.498986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-e0ad6d1b-d0f9-4d47-9ff2-28f52c15ad91 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] HTTP exception thrown: Instance 92bf6a17-fa9f-410e-b25d-4053de456900 is not attached to volume 36cbabf0-84ef-44b7-80fe-d43fc295534b May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e0ad6d1b-d0f9-4d47-9ff2-28f52c15ad91 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Request method failure captured: May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments/36cbabf0-84ef-44b7-80fe-d43fc295534b HTTP/1.1 May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflznCpdYVwwp4936B_Wum1azYnMc2-miA4vzr3IwFtpaAbybfRUuyfcpa8pxTpyoPLFoktowvGc6zkwluY-c2itgrF-WnBAT5aOacQIlKpQT9ep0-9VQCiO__0AcJO1QodE-ABP0ySvNRPZTEku1H3b2rDgi92G_Bf_cYQn2csIECbw May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 1503b2654ff7475b98032519919ae481 May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-TestMinimumBasicScenario-1588527270 May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:31:17.506237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:31:17.507914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1503b2654ff7475b98032519919ae481"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1503b2654ff7475b98032519919ae481", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1503b2654ff7475b98032519919ae481"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1503b2654ff7475b98032519919ae481"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:31:17.507914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-TestMinimumBasicScenario-1588527270 May 13 13:31:17.507914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 1503b2654ff7475b98032519919ae481 May 13 13:31:17.507914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1588527270 May 13 13:31:17.507914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-TestMinimumBasicScenario-1588527270-project May 13 13:31:17.507914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:31:17.507914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:31:17.507914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 015fce3883ab4ee0960565c1a51f520d May 13 13:31:17.507914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-TestMinimumBasicScenario-1588527270-project May 13 13:31:17.507914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:31:17.507914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance 92bf6a17-fa9f-410e-b25d-4053de456900 is not attached to volume 36cbabf0-84ef-44b7-80fe-d43fc295534b May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'server_id': '92bf6a17-fa9f-410e-b25d-4053de456900', 'id': '36cbabf0-84ef-44b7-80fe-d43fc295534b'} May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 36cbabf0-84ef-44b7-80fe-d43fc295534b. May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:31:17.508847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92bf6a17-fa9f-410e-b25d-4053de456900 is not attached to volume 36cbabf0-84ef-44b7-80fe-d43fc295534b May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92bf6a17-fa9f-410e-b25d-4053de456900 is not attached to volume 36cbabf0-84ef-44b7-80fe-d43fc295534b May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:31:17.510393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e0ad6d1b-d0f9-4d47-9ff2-28f52c15ad91 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Returning 404 to user: Instance 92bf6a17-fa9f-410e-b25d-4053de456900 is not attached to volume 36cbabf0-84ef-44b7-80fe-d43fc295534b {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:31:17.511515 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e0ad6d1b-d0f9-4d47-9ff2-28f52c15ad91 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments/36cbabf0-84ef-44b7-80fe-d43fc295534b" status: 404 len: 154 microversion: 2.1 time: 0.127041 May 13 13:31:17.514996 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 411/801] 10.222.0.25 () {58 vars in 1415 bytes} [Fri May 13 13:31:17 2022] DELETE /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900/os-volume_attachments/36cbabf0-84ef-44b7-80fe-d43fc295534b => generated 154 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:31:17.868138 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c7781654-30a6-4122-8479-57abefe6b0f8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:17.868758 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c7781654-30a6-4122-8479-57abefe6b0f8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:17.875170 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c7781654-30a6-4122-8479-57abefe6b0f8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:17.875942 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c7781654-30a6-4122-8479-57abefe6b0f8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:17.877011 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c7781654-30a6-4122-8479-57abefe6b0f8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:17.877499 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c7781654-30a6-4122-8479-57abefe6b0f8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:18.018534 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c7781654-30a6-4122-8479-57abefe6b0f8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:18.027372 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c7781654-30a6-4122-8479-57abefe6b0f8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:18.029305 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c7781654-30a6-4122-8479-57abefe6b0f8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:18.030511 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c7781654-30a6-4122-8479-57abefe6b0f8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1742 microversion: 2.20 time: 0.166335 May 13 13:31:18.035119 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 391/802] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:17 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:18.235049 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2c46dd7b-ca20-4191-97ed-4c823d8777c6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:18.235771 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2c46dd7b-ca20-4191-97ed-4c823d8777c6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:18.241708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2c46dd7b-ca20-4191-97ed-4c823d8777c6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:18.242193 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2c46dd7b-ca20-4191-97ed-4c823d8777c6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:18.242968 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2c46dd7b-ca20-4191-97ed-4c823d8777c6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:18.243411 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2c46dd7b-ca20-4191-97ed-4c823d8777c6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:18.544483 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2c46dd7b-ca20-4191-97ed-4c823d8777c6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:18.590029 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2c46dd7b-ca20-4191-97ed-4c823d8777c6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1366 microversion: 2.1 time: 0.347516 May 13 13:31:18.599695 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 412/803] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:18 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:18.898430 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ea2e2500-580b-4522-9aea-0d2c18509107 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:18.899719 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ea2e2500-580b-4522-9aea-0d2c18509107 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:18.914537 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-0193c91d-8e89-4534-9b50-1163fb7c25fb req-46b9bbf5-abaf-44b3-bde3-3796f57c3d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbc38e8-eda7-4bc6-86c3-be36a0ed8e78", "tag": "d5df665f-4727-4295-aefc-8229d56a25ad"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:18.933637 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-0193c91d-8e89-4534-9b50-1163fb7c25fb req-46b9bbf5-abaf-44b3-bde3-3796f57c3d5e service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:18.934828 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ea2e2500-580b-4522-9aea-0d2c18509107 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:18.935256 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-0193c91d-8e89-4534-9b50-1163fb7c25fb req-46b9bbf5-abaf-44b3-bde3-3796f57c3d5e service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:18.936885 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ea2e2500-580b-4522-9aea-0d2c18509107 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:18.940142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ea2e2500-580b-4522-9aea-0d2c18509107 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:18.941604 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ea2e2500-580b-4522-9aea-0d2c18509107 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:18.969145 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-0193c91d-8e89-4534-9b50-1163fb7c25fb req-46b9bbf5-abaf-44b3-bde3-3796f57c3d5e service nova] Creating event network-changed:d5df665f-4727-4295-aefc-8229d56a25ad for instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 on hv-cinder-84159 May 13 13:31:18.975776 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-0193c91d-8e89-4534-9b50-1163fb7c25fb req-46b9bbf5-abaf-44b3-bde3-3796f57c3d5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063294 May 13 13:31:18.981022 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 413/804] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:31:18.995583 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ea2e2500-580b-4522-9aea-0d2c18509107 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Going to try to terminate instance {{(pid=117602) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:31:19.052561 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bb17b043-98cb-41c6-8928-1dc3d1e97af6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:19.053271 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bb17b043-98cb-41c6-8928-1dc3d1e97af6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:19.067687 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bb17b043-98cb-41c6-8928-1dc3d1e97af6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:19.068151 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bb17b043-98cb-41c6-8928-1dc3d1e97af6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:19.068951 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bb17b043-98cb-41c6-8928-1dc3d1e97af6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:19.069386 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bb17b043-98cb-41c6-8928-1dc3d1e97af6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:19.363967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bb17b043-98cb-41c6-8928-1dc3d1e97af6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:19.379797 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bb17b043-98cb-41c6-8928-1dc3d1e97af6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:19.383458 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-bb17b043-98cb-41c6-8928-1dc3d1e97af6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:19.383458 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bb17b043-98cb-41c6-8928-1dc3d1e97af6 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1742 microversion: 2.20 time: 0.335975 May 13 13:31:19.384032 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 414/805] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:19 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1742 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:19.457555 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ea2e2500-580b-4522-9aea-0d2c18509107 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "DELETE /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 204 len: 0 microversion: 2.1 time: 0.563203 May 13 13:31:19.459368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 392/806] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:31:18 2022] DELETE /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:31:19.470575 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ade5e742-eee7-427b-adfb-177065b20dad tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:19.471693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ade5e742-eee7-427b-adfb-177065b20dad tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:19.488833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ade5e742-eee7-427b-adfb-177065b20dad tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:19.494004 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ade5e742-eee7-427b-adfb-177065b20dad tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:19.502489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ade5e742-eee7-427b-adfb-177065b20dad tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:19.503738 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ade5e742-eee7-427b-adfb-177065b20dad tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:19.540757 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-31b7a5c8-bf4f-4930-a358-7ecce89d634d req-6d56b491-5960-46bf-bb99-f9cd28ec17cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3", "name": "network-vif-plugged", "status": "completed", "tag": "ed34b0e2-4b0c-4721-9e85-8167943bb597"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:19.550172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-31b7a5c8-bf4f-4930-a358-7ecce89d634d req-6d56b491-5960-46bf-bb99-f9cd28ec17cb service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:19.551546 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-31b7a5c8-bf4f-4930-a358-7ecce89d634d req-6d56b491-5960-46bf-bb99-f9cd28ec17cb service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:19.571166 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-31b7a5c8-bf4f-4930-a358-7ecce89d634d req-6d56b491-5960-46bf-bb99-f9cd28ec17cb service nova] Creating event network-vif-plugged:ed34b0e2-4b0c-4721-9e85-8167943bb597 for instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 on hv-cinder-84159 May 13 13:31:19.577370 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-31b7a5c8-bf4f-4930-a358-7ecce89d634d req-6d56b491-5960-46bf-bb99-f9cd28ec17cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191851 May 13 13:31:19.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 415/807] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:19.609287 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-68a60e12-3a95-48ea-b6fa-a3dcda80551d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:19.611064 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-68a60e12-3a95-48ea-b6fa-a3dcda80551d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:19.618117 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-68a60e12-3a95-48ea-b6fa-a3dcda80551d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:19.618798 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-68a60e12-3a95-48ea-b6fa-a3dcda80551d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:19.619749 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-68a60e12-3a95-48ea-b6fa-a3dcda80551d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:19.620178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-68a60e12-3a95-48ea-b6fa-a3dcda80551d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:19.710277 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ade5e742-eee7-427b-adfb-177065b20dad tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:19.720846 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ade5e742-eee7-427b-adfb-177065b20dad tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1552 microversion: 2.1 time: 0.255231 May 13 13:31:19.722248 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 393/808] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:19 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1552 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:31:19.870252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-68a60e12-3a95-48ea-b6fa-a3dcda80551d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:19.884081 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-68a60e12-3a95-48ea-b6fa-a3dcda80551d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1366 microversion: 2.1 time: 0.279737 May 13 13:31:19.885254 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 416/809] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:19 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:20.402081 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-626d60d3-f50c-46ce-bf1c-fcd331ba27b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:20.402757 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-626d60d3-f50c-46ce-bf1c-fcd331ba27b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:20.410603 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-626d60d3-f50c-46ce-bf1c-fcd331ba27b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:20.411062 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-626d60d3-f50c-46ce-bf1c-fcd331ba27b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:20.411848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-626d60d3-f50c-46ce-bf1c-fcd331ba27b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:20.412540 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-626d60d3-f50c-46ce-bf1c-fcd331ba27b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:20.580953 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-626d60d3-f50c-46ce-bf1c-fcd331ba27b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:20.662922 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-626d60d3-f50c-46ce-bf1c-fcd331ba27b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:20.662922 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-626d60d3-f50c-46ce-bf1c-fcd331ba27b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:20.662922 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-626d60d3-f50c-46ce-bf1c-fcd331ba27b0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1742 microversion: 2.20 time: 0.197165 May 13 13:31:20.663396 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 394/810] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:20 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1742 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:20.739103 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fa8ac13e-4885-46f4-b196-4617ac4ed824 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:20.739722 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fa8ac13e-4885-46f4-b196-4617ac4ed824 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:20.748721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fa8ac13e-4885-46f4-b196-4617ac4ed824 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:20.749636 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fa8ac13e-4885-46f4-b196-4617ac4ed824 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:20.751311 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fa8ac13e-4885-46f4-b196-4617ac4ed824 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:20.751915 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fa8ac13e-4885-46f4-b196-4617ac4ed824 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:20.895930 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fa8ac13e-4885-46f4-b196-4617ac4ed824 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:20.900256 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a94acccb-6aa2-4a38-92cb-224df2fc018e tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:20.900871 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a94acccb-6aa2-4a38-92cb-224df2fc018e tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:20.906253 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fa8ac13e-4885-46f4-b196-4617ac4ed824 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1552 microversion: 2.1 time: 0.170999 May 13 13:31:20.907835 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 417/811] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:20 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:20.922714 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a94acccb-6aa2-4a38-92cb-224df2fc018e tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:20.922714 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a94acccb-6aa2-4a38-92cb-224df2fc018e tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:20.922714 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a94acccb-6aa2-4a38-92cb-224df2fc018e tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:20.922714 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a94acccb-6aa2-4a38-92cb-224df2fc018e tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:21.080141 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a94acccb-6aa2-4a38-92cb-224df2fc018e tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:21.089208 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a94acccb-6aa2-4a38-92cb-224df2fc018e tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1366 microversion: 2.1 time: 0.192624 May 13 13:31:21.090119 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 395/812] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:20 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:31:21.614581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a13b505e-7836-4fe1-a951-5c7a57fb690b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:21.615441 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a13b505e-7836-4fe1-a951-5c7a57fb690b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:21.621481 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a13b505e-7836-4fe1-a951-5c7a57fb690b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:21.621986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a13b505e-7836-4fe1-a951-5c7a57fb690b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:21.622847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a13b505e-7836-4fe1-a951-5c7a57fb690b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:21.623283 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a13b505e-7836-4fe1-a951-5c7a57fb690b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:21.834563 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a13b505e-7836-4fe1-a951-5c7a57fb690b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:21.845196 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a13b505e-7836-4fe1-a951-5c7a57fb690b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:21.851948 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a13b505e-7836-4fe1-a951-5c7a57fb690b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:21.853426 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a13b505e-7836-4fe1-a951-5c7a57fb690b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1742 microversion: 2.20 time: 0.242895 May 13 13:31:21.854195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 418/813] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:21 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1742 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:21.925875 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7782415d-8d9b-472c-8869-5cbe61a8f4e0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:21.926685 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7782415d-8d9b-472c-8869-5cbe61a8f4e0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:21.934930 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7782415d-8d9b-472c-8869-5cbe61a8f4e0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:21.935382 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7782415d-8d9b-472c-8869-5cbe61a8f4e0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:21.936164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7782415d-8d9b-472c-8869-5cbe61a8f4e0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:21.936603 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7782415d-8d9b-472c-8869-5cbe61a8f4e0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:22.109052 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6aa11de9-42f2-433c-af9f-5a471372d712 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:22.110595 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6aa11de9-42f2-433c-af9f-5a471372d712 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:22.116732 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-7782415d-8d9b-472c-8869-5cbe61a8f4e0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:22.120875 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6aa11de9-42f2-433c-af9f-5a471372d712 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:22.123247 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6aa11de9-42f2-433c-af9f-5a471372d712 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:22.124255 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6aa11de9-42f2-433c-af9f-5a471372d712 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:22.124814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7782415d-8d9b-472c-8869-5cbe61a8f4e0 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1552 microversion: 2.1 time: 0.203995 May 13 13:31:22.125444 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 396/814] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:21 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1552 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:22.133139 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6aa11de9-42f2-433c-af9f-5a471372d712 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:22.249775 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-da08c2d0-6d93-449e-a482-deb15af67968 req-e2412b2c-693f-4965-b46b-24ff39ebf0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92bf6a17-fa9f-410e-b25d-4053de456900", "name": "network-vif-deleted", "tag": "77185538-d455-4ce8-942b-c0fc75b37ded"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:22.259001 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-da08c2d0-6d93-449e-a482-deb15af67968 req-e2412b2c-693f-4965-b46b-24ff39ebf0b3 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:22.259447 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-da08c2d0-6d93-449e-a482-deb15af67968 req-e2412b2c-693f-4965-b46b-24ff39ebf0b3 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:22.273820 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-da08c2d0-6d93-449e-a482-deb15af67968 req-e2412b2c-693f-4965-b46b-24ff39ebf0b3 service nova] Creating event network-vif-deleted:77185538-d455-4ce8-942b-c0fc75b37ded for instance 92bf6a17-fa9f-410e-b25d-4053de456900 on hv-cinder-84159 May 13 13:31:22.279374 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-da08c2d0-6d93-449e-a482-deb15af67968 req-e2412b2c-693f-4965-b46b-24ff39ebf0b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039381 May 13 13:31:22.280319 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 397/815] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:31:22.327554 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6aa11de9-42f2-433c-af9f-5a471372d712 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:22.340293 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6aa11de9-42f2-433c-af9f-5a471372d712 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1366 microversion: 2.1 time: 0.235148 May 13 13:31:22.341206 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 419/816] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:22 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:31:22.872829 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ee6da489-94ed-49a9-ac14-62e2e16052bf tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:22.873571 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ee6da489-94ed-49a9-ac14-62e2e16052bf tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:22.880650 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ee6da489-94ed-49a9-ac14-62e2e16052bf tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:22.881101 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ee6da489-94ed-49a9-ac14-62e2e16052bf tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:22.881908 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ee6da489-94ed-49a9-ac14-62e2e16052bf tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:22.882349 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ee6da489-94ed-49a9-ac14-62e2e16052bf tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:23.066095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ee6da489-94ed-49a9-ac14-62e2e16052bf tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:23.089688 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ee6da489-94ed-49a9-ac14-62e2e16052bf tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:23.091661 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ee6da489-94ed-49a9-ac14-62e2e16052bf tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:23.092649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ee6da489-94ed-49a9-ac14-62e2e16052bf tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1742 microversion: 2.20 time: 0.224032 May 13 13:31:23.093397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 398/817] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:22 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1742 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:23.143933 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-99225ee3-8e78-4ad4-b676-81da90afac24 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:23.145259 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-99225ee3-8e78-4ad4-b676-81da90afac24 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:23.161065 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-99225ee3-8e78-4ad4-b676-81da90afac24 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:23.161526 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-99225ee3-8e78-4ad4-b676-81da90afac24 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:23.162597 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-99225ee3-8e78-4ad4-b676-81da90afac24 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:23.163089 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-99225ee3-8e78-4ad4-b676-81da90afac24 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:23.205954 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-99225ee3-8e78-4ad4-b676-81da90afac24 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:23.206408 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-99225ee3-8e78-4ad4-b676-81da90afac24 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:23.206866 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-99225ee3-8e78-4ad4-b676-81da90afac24 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lazy-loading 'fault' on Instance uuid 92bf6a17-fa9f-410e-b25d-4053de456900 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:31:23.260829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-99225ee3-8e78-4ad4-b676-81da90afac24 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '015fce3883ab4ee0960565c1a51f520d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1503b2654ff7475b98032519919ae481', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:23.269132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-99225ee3-8e78-4ad4-b676-81da90afac24 tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 200 len: 1347 microversion: 2.1 time: 0.129999 May 13 13:31:23.279523 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 420/818] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:23 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 1347 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:23.357834 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-05b758fc-b438-4b6e-b443-7403a16b4d13 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:23.358461 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-05b758fc-b438-4b6e-b443-7403a16b4d13 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:23.364644 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-05b758fc-b438-4b6e-b443-7403a16b4d13 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:23.365101 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-05b758fc-b438-4b6e-b443-7403a16b4d13 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:23.365910 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-05b758fc-b438-4b6e-b443-7403a16b4d13 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:23.366381 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-05b758fc-b438-4b6e-b443-7403a16b4d13 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:23.518721 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-05b758fc-b438-4b6e-b443-7403a16b4d13 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:23.526178 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-05b758fc-b438-4b6e-b443-7403a16b4d13 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1366 microversion: 2.1 time: 0.172135 May 13 13:31:23.527931 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 399/819] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:23 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:24.115485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3472cb7d-0b91-4ddb-8116-ebf09416b88b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:24.117746 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3472cb7d-0b91-4ddb-8116-ebf09416b88b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:24.130468 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3472cb7d-0b91-4ddb-8116-ebf09416b88b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:24.131111 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3472cb7d-0b91-4ddb-8116-ebf09416b88b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:24.131927 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3472cb7d-0b91-4ddb-8116-ebf09416b88b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:24.132394 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3472cb7d-0b91-4ddb-8116-ebf09416b88b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:24.282951 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3472cb7d-0b91-4ddb-8116-ebf09416b88b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:24.288350 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-14e95d53-0407-4822-86f0-d50a028b604e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:24.288972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-14e95d53-0407-4822-86f0-d50a028b604e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] [instance: 92bf6a17-fa9f-410e-b25d-4053de456900] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:24.292296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3472cb7d-0b91-4ddb-8116-ebf09416b88b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:24.294046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3472cb7d-0b91-4ddb-8116-ebf09416b88b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:24.295335 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3472cb7d-0b91-4ddb-8116-ebf09416b88b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1742 microversion: 2.20 time: 0.187340 May 13 13:31:24.295918 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 421/820] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:24 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:24.303116 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-14e95d53-0407-4822-86f0-d50a028b604e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:24.303571 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-14e95d53-0407-4822-86f0-d50a028b604e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:24.309081 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-14e95d53-0407-4822-86f0-d50a028b604e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:24.309081 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-14e95d53-0407-4822-86f0-d50a028b604e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:24.320228 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-14e95d53-0407-4822-86f0-d50a028b604e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] HTTP exception thrown: Instance 92bf6a17-fa9f-410e-b25d-4053de456900 could not be found. May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-14e95d53-0407-4822-86f0-d50a028b604e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Request method failure captured: May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 HTTP/1.1 May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflznCpdYVwwp4936B_Wum1azYnMc2-miA4vzr3IwFtpaAbybfRUuyfcpa8pxTpyoPLFoktowvGc6zkwluY-c2itgrF-WnBAT5aOacQIlKpQT9ep0-9VQCiO__0AcJO1QodE-ABP0ySvNRPZTEku1H3b2rDgi92G_Bf_cYQn2csIECbw May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 1503b2654ff7475b98032519919ae481 May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-TestMinimumBasicScenario-1588527270 May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:31:24.321977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:31:24.335810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1503b2654ff7475b98032519919ae481"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1503b2654ff7475b98032519919ae481", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1503b2654ff7475b98032519919ae481"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1503b2654ff7475b98032519919ae481"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:31:24.335810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-TestMinimumBasicScenario-1588527270 May 13 13:31:24.335810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 1503b2654ff7475b98032519919ae481 May 13 13:31:24.335810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1588527270 May 13 13:31:24.335810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-TestMinimumBasicScenario-1588527270-project May 13 13:31:24.335810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:31:24.335810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:31:24.335810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 015fce3883ab4ee0960565c1a51f520d May 13 13:31:24.335810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-TestMinimumBasicScenario-1588527270-project May 13 13:31:24.335810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:31:24.335810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 92bf6a17-fa9f-410e-b25d-4053de456900 could not be found. May 13 13:31:24.335810 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '92bf6a17-fa9f-410e-b25d-4053de456900'} May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92bf6a17-fa9f-410e-b25d-4053de456900 could not be found. May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:31:24.336816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92bf6a17-fa9f-410e-b25d-4053de456900 could not be found. May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92bf6a17-fa9f-410e-b25d-4053de456900 could not be found. May 13 13:31:24.343694 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:31:24.357241 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-14e95d53-0407-4822-86f0-d50a028b604e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Returning 404 to user: Instance 92bf6a17-fa9f-410e-b25d-4053de456900 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:31:24.357241 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-14e95d53-0407-4822-86f0-d50a028b604e tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900" status: 404 len: 111 microversion: 2.1 time: 0.038834 May 13 13:31:24.357241 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 400/821] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:24 2022] GET /compute/v2.1/servers/92bf6a17-fa9f-410e-b25d-4053de456900 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:31:24.357747 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6e95aab7-5fd6-450f-bf5b-6744f9c0580b tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] Calling method '.version_select at 0x7faaa1cde820>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:24.426984 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6e95aab7-5fd6-450f-bf5b-6744f9c0580b tempest-TestMinimumBasicScenario-1588527270 tempest-TestMinimumBasicScenario-1588527270-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-568186673" status: 202 len: 0 microversion: 2.1 time: 0.098265 May 13 13:31:24.427492 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 422/822] 10.222.0.25 () {58 vars in 1268 bytes} [Fri May 13 13:31:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-568186673 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:31:24.558748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e94bf030-e288-443e-b29c-2a2c0807d45d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:24.558748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e94bf030-e288-443e-b29c-2a2c0807d45d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:24.558748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e94bf030-e288-443e-b29c-2a2c0807d45d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:24.558748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e94bf030-e288-443e-b29c-2a2c0807d45d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:24.563413 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e94bf030-e288-443e-b29c-2a2c0807d45d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:24.563413 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e94bf030-e288-443e-b29c-2a2c0807d45d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:24.691460 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e94bf030-e288-443e-b29c-2a2c0807d45d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:24.700118 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e94bf030-e288-443e-b29c-2a2c0807d45d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1366 microversion: 2.1 time: 0.160693 May 13 13:31:24.700700 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 401/823] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:24 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:25.315078 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-53c6218c-f8e5-4f6d-a68c-83faf0316cd1 req-a5f5128e-15d7-447b-ae28-e4e9fc1baefc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbc38e8-eda7-4bc6-86c3-be36a0ed8e78", "name": "network-vif-plugged", "status": "completed", "tag": "d5df665f-4727-4295-aefc-8229d56a25ad"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:25.315924 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-531b4907-0c02-42b8-89c3-ea1a64723a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:25.315924 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-531b4907-0c02-42b8-89c3-ea1a64723a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:25.327774 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-531b4907-0c02-42b8-89c3-ea1a64723a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:25.329048 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-531b4907-0c02-42b8-89c3-ea1a64723a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:25.330073 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-531b4907-0c02-42b8-89c3-ea1a64723a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:25.330928 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-531b4907-0c02-42b8-89c3-ea1a64723a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:25.331179 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-53c6218c-f8e5-4f6d-a68c-83faf0316cd1 req-a5f5128e-15d7-447b-ae28-e4e9fc1baefc service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:25.338172 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-53c6218c-f8e5-4f6d-a68c-83faf0316cd1 req-a5f5128e-15d7-447b-ae28-e4e9fc1baefc service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:25.351242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-53c6218c-f8e5-4f6d-a68c-83faf0316cd1 req-a5f5128e-15d7-447b-ae28-e4e9fc1baefc service nova] Creating event network-vif-plugged:d5df665f-4727-4295-aefc-8229d56a25ad for instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 on hv-cinder-84159 May 13 13:31:25.360280 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-53c6218c-f8e5-4f6d-a68c-83faf0316cd1 req-a5f5128e-15d7-447b-ae28-e4e9fc1baefc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052018 May 13 13:31:25.360882 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 423/824] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:31:25.518758 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-531b4907-0c02-42b8-89c3-ea1a64723a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:25.528445 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-531b4907-0c02-42b8-89c3-ea1a64723a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:25.532218 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-531b4907-0c02-42b8-89c3-ea1a64723a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:25.533601 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-531b4907-0c02-42b8-89c3-ea1a64723a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1742 microversion: 2.20 time: 0.223616 May 13 13:31:25.535063 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 402/825] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:25 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1742 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:31:25.722262 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7080c7cb-0227-4190-a2b1-d3cbf4073716 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:25.724522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7080c7cb-0227-4190-a2b1-d3cbf4073716 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:25.732916 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7080c7cb-0227-4190-a2b1-d3cbf4073716 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:25.734800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7080c7cb-0227-4190-a2b1-d3cbf4073716 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:25.735753 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7080c7cb-0227-4190-a2b1-d3cbf4073716 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:25.736193 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7080c7cb-0227-4190-a2b1-d3cbf4073716 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:26.253399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7080c7cb-0227-4190-a2b1-d3cbf4073716 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:26.263634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7080c7cb-0227-4190-a2b1-d3cbf4073716 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1366 microversion: 2.1 time: 0.545662 May 13 13:31:26.269323 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 424/826] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:25 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1366 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:26.557719 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1afda6f3-ad3e-4870-94cc-da07a88dd01f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:26.559162 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1afda6f3-ad3e-4870-94cc-da07a88dd01f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:26.569229 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1afda6f3-ad3e-4870-94cc-da07a88dd01f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:26.570010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1afda6f3-ad3e-4870-94cc-da07a88dd01f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:26.571149 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1afda6f3-ad3e-4870-94cc-da07a88dd01f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:26.571748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1afda6f3-ad3e-4870-94cc-da07a88dd01f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:26.718557 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1afda6f3-ad3e-4870-94cc-da07a88dd01f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:26.731095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1afda6f3-ad3e-4870-94cc-da07a88dd01f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:26.733001 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1afda6f3-ad3e-4870-94cc-da07a88dd01f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:26.735017 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1afda6f3-ad3e-4870-94cc-da07a88dd01f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1742 microversion: 2.20 time: 0.184907 May 13 13:31:26.735782 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 403/827] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:26 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1742 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:27.280990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-69eab1ec-b78b-4649-a068-1fc4a33a2689 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:27.293740 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-69eab1ec-b78b-4649-a068-1fc4a33a2689 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:27.301292 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-69eab1ec-b78b-4649-a068-1fc4a33a2689 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:27.305900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-69eab1ec-b78b-4649-a068-1fc4a33a2689 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:27.307217 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-69eab1ec-b78b-4649-a068-1fc4a33a2689 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:27.308011 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-69eab1ec-b78b-4649-a068-1fc4a33a2689 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:27.492299 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-69eab1ec-b78b-4649-a068-1fc4a33a2689 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:27.503839 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-69eab1ec-b78b-4649-a068-1fc4a33a2689 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1366 microversion: 2.1 time: 0.227149 May 13 13:31:27.515642 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 425/828] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:27 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:27.757400 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b193e666-5979-4b50-94b6-9677927e9ebe tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:27.758576 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b193e666-5979-4b50-94b6-9677927e9ebe tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:27.765355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b193e666-5979-4b50-94b6-9677927e9ebe tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:27.765959 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b193e666-5979-4b50-94b6-9677927e9ebe tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:27.766819 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b193e666-5979-4b50-94b6-9677927e9ebe tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:27.767525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b193e666-5979-4b50-94b6-9677927e9ebe tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:28.014155 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b193e666-5979-4b50-94b6-9677927e9ebe tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:28.021001 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b193e666-5979-4b50-94b6-9677927e9ebe tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:28.025396 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b193e666-5979-4b50-94b6-9677927e9ebe tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:28.026979 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b193e666-5979-4b50-94b6-9677927e9ebe tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1742 microversion: 2.20 time: 0.273675 May 13 13:31:28.027729 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 404/829] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:27 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1742 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:28.330602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-32d01ad6-affa-418b-89ad-3606b4ef78ef tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:28.331426 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-32d01ad6-affa-418b-89ad-3606b4ef78ef tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:28.337600 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-32d01ad6-affa-418b-89ad-3606b4ef78ef tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:28.338081 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-32d01ad6-affa-418b-89ad-3606b4ef78ef tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:28.338837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-32d01ad6-affa-418b-89ad-3606b4ef78ef tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:28.339271 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-32d01ad6-affa-418b-89ad-3606b4ef78ef tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:28.363197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-32d01ad6-affa-418b-89ad-3606b4ef78ef tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/ips" status: 200 len: 144 microversion: 2.1 time: 0.038690 May 13 13:31:28.364402 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 426/830] 10.222.0.25 () {58 vars in 1247 bytes} [Fri May 13 13:31:28 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:28.523442 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-41fb5eb5-9b24-4a7f-8609-43eed67bf2cf tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:28.524100 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-41fb5eb5-9b24-4a7f-8609-43eed67bf2cf tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:28.530427 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-41fb5eb5-9b24-4a7f-8609-43eed67bf2cf tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:28.530938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-41fb5eb5-9b24-4a7f-8609-43eed67bf2cf tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:28.531785 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-41fb5eb5-9b24-4a7f-8609-43eed67bf2cf tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:28.532229 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-41fb5eb5-9b24-4a7f-8609-43eed67bf2cf tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:28.789575 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-41fb5eb5-9b24-4a7f-8609-43eed67bf2cf tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:28.809187 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-41fb5eb5-9b24-4a7f-8609-43eed67bf2cf tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1366 microversion: 2.1 time: 0.286777 May 13 13:31:28.809187 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 405/831] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:28 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:29.047949 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5c337a87-ae1c-41d6-a5d7-bde008e3ae09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:29.048658 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5c337a87-ae1c-41d6-a5d7-bde008e3ae09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:29.055277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c337a87-ae1c-41d6-a5d7-bde008e3ae09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:29.055962 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c337a87-ae1c-41d6-a5d7-bde008e3ae09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:29.056987 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c337a87-ae1c-41d6-a5d7-bde008e3ae09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:29.057660 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5c337a87-ae1c-41d6-a5d7-bde008e3ae09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:29.262641 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5c337a87-ae1c-41d6-a5d7-bde008e3ae09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:29.273739 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5c337a87-ae1c-41d6-a5d7-bde008e3ae09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:29.275969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5c337a87-ae1c-41d6-a5d7-bde008e3ae09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:29.277970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5c337a87-ae1c-41d6-a5d7-bde008e3ae09 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1742 microversion: 2.20 time: 0.236776 May 13 13:31:29.290863 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 427/832] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:29 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1742 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:29.823836 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b5ae4ae7-761c-476e-8712-8d248d90f93f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:29.826296 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b5ae4ae7-761c-476e-8712-8d248d90f93f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:29.834070 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b5ae4ae7-761c-476e-8712-8d248d90f93f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:29.834760 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b5ae4ae7-761c-476e-8712-8d248d90f93f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:29.835932 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b5ae4ae7-761c-476e-8712-8d248d90f93f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:29.836386 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b5ae4ae7-761c-476e-8712-8d248d90f93f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:30.175210 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-570c9b41-6822-402a-a1e4-f16a5fe25aba tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7ced73c-6137-41e9-9513-6beb200ab7da"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:30.176281 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-570c9b41-6822-402a-a1e4-f16a5fe25aba tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:30.182480 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-570c9b41-6822-402a-a1e4-f16a5fe25aba tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:30.182928 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-570c9b41-6822-402a-a1e4-f16a5fe25aba tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:30.183696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-570c9b41-6822-402a-a1e4-f16a5fe25aba tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:30.184134 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-570c9b41-6822-402a-a1e4-f16a5fe25aba tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:30.227502 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b5ae4ae7-761c-476e-8712-8d248d90f93f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:30.245950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b5ae4ae7-761c-476e-8712-8d248d90f93f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1556 microversion: 2.1 time: 0.426016 May 13 13:31:30.246577 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 406/833] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:31:29 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1556 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:31:30.274642 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-773298f0-d00c-4829-990b-4a32f51439fd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:30.275445 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-773298f0-d00c-4829-990b-4a32f51439fd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:30.283893 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-773298f0-d00c-4829-990b-4a32f51439fd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:30.284923 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-773298f0-d00c-4829-990b-4a32f51439fd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:30.286645 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-773298f0-d00c-4829-990b-4a32f51439fd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:30.287202 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-773298f0-d00c-4829-990b-4a32f51439fd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:30.387445 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-773298f0-d00c-4829-990b-4a32f51439fd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119284 May 13 13:31:30.388028 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 407/834] 10.222.0.25 () {58 vars in 1274 bytes} [Fri May 13 13:31:30 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:30.392569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-21d472c5-885a-40db-8e35-01b91e322e4f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:30.393160 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-21d472c5-885a-40db-8e35-01b91e322e4f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:30.399377 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21d472c5-885a-40db-8e35-01b91e322e4f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:30.399825 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21d472c5-885a-40db-8e35-01b91e322e4f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:30.400819 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21d472c5-885a-40db-8e35-01b91e322e4f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:30.401422 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-21d472c5-885a-40db-8e35-01b91e322e4f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:30.781973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-21d472c5-885a-40db-8e35-01b91e322e4f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:30.791279 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-21d472c5-885a-40db-8e35-01b91e322e4f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:30.792942 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-21d472c5-885a-40db-8e35-01b91e322e4f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:30.794338 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-21d472c5-885a-40db-8e35-01b91e322e4f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1724 microversion: 2.20 time: 0.405385 May 13 13:31:30.795220 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 408/835] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:30 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1724 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:31.213303 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-570c9b41-6822-402a-a1e4-f16a5fe25aba tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "POST /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.036628 May 13 13:31:31.213303 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 428/836] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:31:30 2022] POST /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments => generated 194 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:31:31.800987 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-3d87b695-0f6b-4578-a86d-087ae2505009 req-dbb94f28-be33-492c-aa0e-bf8724b89306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adbc38e8-eda7-4bc6-86c3-be36a0ed8e78", "tag": "d5df665f-4727-4295-aefc-8229d56a25ad"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:31.810983 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-3d87b695-0f6b-4578-a86d-087ae2505009 req-dbb94f28-be33-492c-aa0e-bf8724b89306 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:31.811438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-3d87b695-0f6b-4578-a86d-087ae2505009 req-dbb94f28-be33-492c-aa0e-bf8724b89306 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:31.816503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ebf48308-77ee-4aa6-927f-1942884c020f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:31.817977 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ebf48308-77ee-4aa6-927f-1942884c020f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:31.823657 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-3d87b695-0f6b-4578-a86d-087ae2505009 req-dbb94f28-be33-492c-aa0e-bf8724b89306 service nova] Creating event network-changed:d5df665f-4727-4295-aefc-8229d56a25ad for instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 on hv-cinder-84159 May 13 13:31:31.830156 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-3d87b695-0f6b-4578-a86d-087ae2505009 req-dbb94f28-be33-492c-aa0e-bf8724b89306 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032126 May 13 13:31:31.832361 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebf48308-77ee-4aa6-927f-1942884c020f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:31.832639 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebf48308-77ee-4aa6-927f-1942884c020f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:31.833694 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebf48308-77ee-4aa6-927f-1942884c020f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:31.834131 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 409/837] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:31.834294 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebf48308-77ee-4aa6-927f-1942884c020f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:31.969554 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ebf48308-77ee-4aa6-927f-1942884c020f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:31.978301 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ebf48308-77ee-4aa6-927f-1942884c020f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:31.980087 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ebf48308-77ee-4aa6-927f-1942884c020f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:31.981533 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ebf48308-77ee-4aa6-927f-1942884c020f tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1724 microversion: 2.20 time: 0.172889 May 13 13:31:31.989531 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 429/838] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:31 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:33.008444 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8e021cf9-27ad-4fd4-9e00-5fe463896edc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:33.009149 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8e021cf9-27ad-4fd4-9e00-5fe463896edc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:33.016919 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8e021cf9-27ad-4fd4-9e00-5fe463896edc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:33.017292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8e021cf9-27ad-4fd4-9e00-5fe463896edc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:33.018099 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8e021cf9-27ad-4fd4-9e00-5fe463896edc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:33.018538 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8e021cf9-27ad-4fd4-9e00-5fe463896edc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:33.253902 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-8e021cf9-27ad-4fd4-9e00-5fe463896edc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:33.262563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-8e021cf9-27ad-4fd4-9e00-5fe463896edc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:33.264225 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-8e021cf9-27ad-4fd4-9e00-5fe463896edc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:33.265391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8e021cf9-27ad-4fd4-9e00-5fe463896edc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1724 microversion: 2.20 time: 0.261809 May 13 13:31:33.268783 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-f143cfbf-c15a-456d-ac62-025cd968ac0c req-6a18612f-6138-4ce6-876d-d81e9db50e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3", "name": "network-vif-unplugged", "status": "completed", "tag": "ed34b0e2-4b0c-4721-9e85-8167943bb597"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:33.284099 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 410/839] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:33 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:33.287697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-f143cfbf-c15a-456d-ac62-025cd968ac0c req-6a18612f-6138-4ce6-876d-d81e9db50e6f service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:33.288204 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-f143cfbf-c15a-456d-ac62-025cd968ac0c req-6a18612f-6138-4ce6-876d-d81e9db50e6f service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:33.306395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-f143cfbf-c15a-456d-ac62-025cd968ac0c req-6a18612f-6138-4ce6-876d-d81e9db50e6f service nova] Creating event network-vif-unplugged:ed34b0e2-4b0c-4721-9e85-8167943bb597 for instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 on hv-cinder-84159 May 13 13:31:33.313439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-f143cfbf-c15a-456d-ac62-025cd968ac0c req-6a18612f-6138-4ce6-876d-d81e9db50e6f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048064 May 13 13:31:33.318937 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 430/840] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:34.292826 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6a6dd7ab-cb74-4e0f-953d-e58ed95fb237 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:34.293446 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6a6dd7ab-cb74-4e0f-953d-e58ed95fb237 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:34.299867 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6a6dd7ab-cb74-4e0f-953d-e58ed95fb237 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:34.300191 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6a6dd7ab-cb74-4e0f-953d-e58ed95fb237 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:34.301004 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6a6dd7ab-cb74-4e0f-953d-e58ed95fb237 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:34.301469 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6a6dd7ab-cb74-4e0f-953d-e58ed95fb237 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:34.527380 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6a6dd7ab-cb74-4e0f-953d-e58ed95fb237 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:34.535177 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6a6dd7ab-cb74-4e0f-953d-e58ed95fb237 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:34.536681 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6a6dd7ab-cb74-4e0f-953d-e58ed95fb237 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:34.537880 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6a6dd7ab-cb74-4e0f-953d-e58ed95fb237 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1667 microversion: 2.20 time: 0.249309 May 13 13:31:34.550744 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 411/841] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:34 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1667 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:34.556735 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-554064c1-f96a-4082-a407-d78cdfdb299a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "354a251d-6d05-440e-afd8-998dea04109b"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:34.558083 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-554064c1-f96a-4082-a407-d78cdfdb299a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:34.565303 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-554064c1-f96a-4082-a407-d78cdfdb299a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:34.565898 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-554064c1-f96a-4082-a407-d78cdfdb299a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:34.567075 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-554064c1-f96a-4082-a407-d78cdfdb299a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:34.567622 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-554064c1-f96a-4082-a407-d78cdfdb299a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:35.676015 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-554064c1-f96a-4082-a407-d78cdfdb299a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "POST /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.123682 May 13 13:31:35.676665 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 431/842] 10.222.0.25 () {62 vars in 1363 bytes} [Fri May 13 13:31:34 2022] POST /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/os-volume_attachments => generated 188 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:31:35.790498 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4a1edc12-3ce9-4bab-b1bc-7f742287f64e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:35.791017 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-4a1edc12-3ce9-4bab-b1bc-7f742287f64e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:35.797919 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4a1edc12-3ce9-4bab-b1bc-7f742287f64e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:35.798379 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4a1edc12-3ce9-4bab-b1bc-7f742287f64e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:35.799156 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4a1edc12-3ce9-4bab-b1bc-7f742287f64e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:35.799957 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4a1edc12-3ce9-4bab-b1bc-7f742287f64e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:36.481824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4a1edc12-3ce9-4bab-b1bc-7f742287f64e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/os-volume_attachments/354a251d-6d05-440e-afd8-998dea04109b" status: 202 len: 0 microversion: 2.20 time: 0.695184 May 13 13:31:36.482685 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 412/843] 10.222.0.25 () {60 vars in 1456 bytes} [Fri May 13 13:31:35 2022] DELETE /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/os-volume_attachments/354a251d-6d05-440e-afd8-998dea04109b => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:31:36.546168 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-77daeb3c-6604-467e-af0d-b319a264de53 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:36.547387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-77daeb3c-6604-467e-af0d-b319a264de53 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:36.553225 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-77daeb3c-6604-467e-af0d-b319a264de53 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:36.553676 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-77daeb3c-6604-467e-af0d-b319a264de53 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:36.554477 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-77daeb3c-6604-467e-af0d-b319a264de53 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:36.554918 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-77daeb3c-6604-467e-af0d-b319a264de53 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:36.787065 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-77daeb3c-6604-467e-af0d-b319a264de53 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "POST /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/action" status: 202 len: 0 microversion: 2.20 time: 0.244758 May 13 13:31:36.787709 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 432/844] 10.222.0.25 () {62 vars in 1318 bytes} [Fri May 13 13:31:36 2022] POST /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:31:36.795816 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e31f2fb3-c8d8-48f2-84eb-d37839e1ad7a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:36.796454 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e31f2fb3-c8d8-48f2-84eb-d37839e1ad7a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:36.803951 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e31f2fb3-c8d8-48f2-84eb-d37839e1ad7a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:36.804602 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e31f2fb3-c8d8-48f2-84eb-d37839e1ad7a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:36.805454 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e31f2fb3-c8d8-48f2-84eb-d37839e1ad7a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:36.805894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e31f2fb3-c8d8-48f2-84eb-d37839e1ad7a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:36.934601 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e31f2fb3-c8d8-48f2-84eb-d37839e1ad7a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:36.942429 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e31f2fb3-c8d8-48f2-84eb-d37839e1ad7a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:36.944323 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e31f2fb3-c8d8-48f2-84eb-d37839e1ad7a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:36.945632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e31f2fb3-c8d8-48f2-84eb-d37839e1ad7a tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1675 microversion: 2.20 time: 0.153662 May 13 13:31:36.946082 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 413/845] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:36 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:37.964892 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5327aedb-01b6-4849-a87e-89e79f640a19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:37.965506 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5327aedb-01b6-4849-a87e-89e79f640a19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:37.974792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5327aedb-01b6-4849-a87e-89e79f640a19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:37.975857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5327aedb-01b6-4849-a87e-89e79f640a19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:37.976849 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5327aedb-01b6-4849-a87e-89e79f640a19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:37.977603 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5327aedb-01b6-4849-a87e-89e79f640a19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:38.114046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5327aedb-01b6-4849-a87e-89e79f640a19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:38.122033 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5327aedb-01b6-4849-a87e-89e79f640a19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:38.123536 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5327aedb-01b6-4849-a87e-89e79f640a19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:38.124698 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5327aedb-01b6-4849-a87e-89e79f640a19 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1677 microversion: 2.20 time: 0.164251 May 13 13:31:38.126053 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 433/846] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:37 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:39.144002 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5a3535ff-b129-4fee-afe6-a5379a2ff9e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:39.145289 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-5a3535ff-b129-4fee-afe6-a5379a2ff9e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:39.153565 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5a3535ff-b129-4fee-afe6-a5379a2ff9e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:39.154155 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5a3535ff-b129-4fee-afe6-a5379a2ff9e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:39.155922 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5a3535ff-b129-4fee-afe6-a5379a2ff9e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:39.157135 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5a3535ff-b129-4fee-afe6-a5379a2ff9e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:39.300049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-5a3535ff-b129-4fee-afe6-a5379a2ff9e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:39.309386 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-5a3535ff-b129-4fee-afe6-a5379a2ff9e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:39.330313 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-5a3535ff-b129-4fee-afe6-a5379a2ff9e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:39.330313 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-5a3535ff-b129-4fee-afe6-a5379a2ff9e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.175901 May 13 13:31:39.331410 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 414/847] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:39 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:40.335136 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5a1060ba-f7f5-430b-8b96-3b117bf0a651 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:40.339680 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5a1060ba-f7f5-430b-8b96-3b117bf0a651 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:40.346513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5a1060ba-f7f5-430b-8b96-3b117bf0a651 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:40.346978 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5a1060ba-f7f5-430b-8b96-3b117bf0a651 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:40.347771 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5a1060ba-f7f5-430b-8b96-3b117bf0a651 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:40.348261 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5a1060ba-f7f5-430b-8b96-3b117bf0a651 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:40.512525 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5a1060ba-f7f5-430b-8b96-3b117bf0a651 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:40.524057 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5a1060ba-f7f5-430b-8b96-3b117bf0a651 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:40.526862 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5a1060ba-f7f5-430b-8b96-3b117bf0a651 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:40.528476 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5a1060ba-f7f5-430b-8b96-3b117bf0a651 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.197608 May 13 13:31:40.540714 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 434/848] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:40 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:40.870643 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d3b3dca3-3b35-44aa-8b31-779a7714e529 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:40.871661 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d3b3dca3-3b35-44aa-8b31-779a7714e529 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:40.878861 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d3b3dca3-3b35-44aa-8b31-779a7714e529 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:40.879320 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d3b3dca3-3b35-44aa-8b31-779a7714e529 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:40.880120 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d3b3dca3-3b35-44aa-8b31-779a7714e529 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:40.880564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d3b3dca3-3b35-44aa-8b31-779a7714e529 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:40.913067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d3b3dca3-3b35-44aa-8b31-779a7714e529 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046211 May 13 13:31:40.913607 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 415/849] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:31:40 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:40.923998 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-efcf5441-17f6-414c-9c74-a57913290843 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:40.924498 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-efcf5441-17f6-414c-9c74-a57913290843 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:40.930831 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-efcf5441-17f6-414c-9c74-a57913290843 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:40.931494 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-efcf5441-17f6-414c-9c74-a57913290843 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:40.932291 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-efcf5441-17f6-414c-9c74-a57913290843 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:40.932747 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-efcf5441-17f6-414c-9c74-a57913290843 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:40.971650 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-efcf5441-17f6-414c-9c74-a57913290843 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments/b7ced73c-6137-41e9-9513-6beb200ab7da" status: 200 len: 194 microversion: 2.1 time: 0.052116 May 13 13:31:40.972417 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 435/850] 10.222.0.25 () {58 vars in 1412 bytes} [Fri May 13 13:31:40 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments/b7ced73c-6137-41e9-9513-6beb200ab7da => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:41.552191 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c85825a1-d09c-4dde-9338-e50d304c9a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:41.552971 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c85825a1-d09c-4dde-9338-e50d304c9a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:41.561019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c85825a1-d09c-4dde-9338-e50d304c9a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:41.561617 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c85825a1-d09c-4dde-9338-e50d304c9a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:41.563321 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c85825a1-d09c-4dde-9338-e50d304c9a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:41.563864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c85825a1-d09c-4dde-9338-e50d304c9a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:41.731032 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c85825a1-d09c-4dde-9338-e50d304c9a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:41.741100 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c85825a1-d09c-4dde-9338-e50d304c9a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:41.749955 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c85825a1-d09c-4dde-9338-e50d304c9a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:41.749955 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c85825a1-d09c-4dde-9338-e50d304c9a87 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.200475 May 13 13:31:41.750547 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 416/851] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:41 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:42.763931 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9245b225-57ab-4bb4-a10f-0a55c3c185ce tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:42.764541 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9245b225-57ab-4bb4-a10f-0a55c3c185ce tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:42.776059 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9245b225-57ab-4bb4-a10f-0a55c3c185ce tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:42.776433 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9245b225-57ab-4bb4-a10f-0a55c3c185ce tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:42.777238 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9245b225-57ab-4bb4-a10f-0a55c3c185ce tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:42.777733 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9245b225-57ab-4bb4-a10f-0a55c3c185ce tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:42.881260 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6e4c556e-7bdb-4439-8218-f0a6e1e393cc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a97eb94-52d3-4a4a-b395-c4acf72d0882"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:42.883035 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6e4c556e-7bdb-4439-8218-f0a6e1e393cc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:42.889385 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6e4c556e-7bdb-4439-8218-f0a6e1e393cc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:42.889871 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6e4c556e-7bdb-4439-8218-f0a6e1e393cc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:42.891354 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6e4c556e-7bdb-4439-8218-f0a6e1e393cc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:42.891793 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6e4c556e-7bdb-4439-8218-f0a6e1e393cc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:43.052359 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9245b225-57ab-4bb4-a10f-0a55c3c185ce tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:43.061102 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9245b225-57ab-4bb4-a10f-0a55c3c185ce tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:43.063582 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9245b225-57ab-4bb4-a10f-0a55c3c185ce tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:43.064951 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9245b225-57ab-4bb4-a10f-0a55c3c185ce tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.305140 May 13 13:31:43.065512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 436/852] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:42 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:44.086861 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1bce78ce-6a03-4a8f-bd61-cda82bb463dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:44.087793 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1bce78ce-6a03-4a8f-bd61-cda82bb463dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:44.098212 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1bce78ce-6a03-4a8f-bd61-cda82bb463dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:44.099047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1bce78ce-6a03-4a8f-bd61-cda82bb463dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:44.100097 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1bce78ce-6a03-4a8f-bd61-cda82bb463dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:44.100759 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1bce78ce-6a03-4a8f-bd61-cda82bb463dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:44.304457 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1bce78ce-6a03-4a8f-bd61-cda82bb463dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:44.320030 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1bce78ce-6a03-4a8f-bd61-cda82bb463dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:44.321898 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1bce78ce-6a03-4a8f-bd61-cda82bb463dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:44.336410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1bce78ce-6a03-4a8f-bd61-cda82bb463dd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.254920 May 13 13:31:44.338993 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 437/853] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:44 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:31:45.355924 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-39c9f915-ca11-42a0-ab18-04f5c4cf06e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:45.356695 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-39c9f915-ca11-42a0-ab18-04f5c4cf06e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:45.368992 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-39c9f915-ca11-42a0-ab18-04f5c4cf06e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:45.374494 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-39c9f915-ca11-42a0-ab18-04f5c4cf06e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:45.377173 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-39c9f915-ca11-42a0-ab18-04f5c4cf06e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:45.377826 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-39c9f915-ca11-42a0-ab18-04f5c4cf06e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:45.537119 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-39c9f915-ca11-42a0-ab18-04f5c4cf06e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:45.563100 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-39c9f915-ca11-42a0-ab18-04f5c4cf06e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:45.575196 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-39c9f915-ca11-42a0-ab18-04f5c4cf06e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:45.576553 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-39c9f915-ca11-42a0-ab18-04f5c4cf06e0 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.224514 May 13 13:31:45.579945 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 438/854] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:45 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:31:46.598902 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-860a2471-53ef-494e-84ce-7f87c51ac8cb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:46.600365 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-860a2471-53ef-494e-84ce-7f87c51ac8cb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:46.607669 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-860a2471-53ef-494e-84ce-7f87c51ac8cb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:46.608514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-860a2471-53ef-494e-84ce-7f87c51ac8cb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:46.610034 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-860a2471-53ef-494e-84ce-7f87c51ac8cb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:46.610758 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-860a2471-53ef-494e-84ce-7f87c51ac8cb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:46.829423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-860a2471-53ef-494e-84ce-7f87c51ac8cb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:46.839957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-860a2471-53ef-494e-84ce-7f87c51ac8cb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:46.842964 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-860a2471-53ef-494e-84ce-7f87c51ac8cb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:46.846168 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-860a2471-53ef-494e-84ce-7f87c51ac8cb tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.250353 May 13 13:31:46.849725 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 439/855] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:46 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:31:47.867664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a42f25f9-ff0b-4eb8-961d-9ccf1dc918d8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:47.869230 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a42f25f9-ff0b-4eb8-961d-9ccf1dc918d8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:47.888296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a42f25f9-ff0b-4eb8-961d-9ccf1dc918d8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:47.889097 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a42f25f9-ff0b-4eb8-961d-9ccf1dc918d8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:47.890106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a42f25f9-ff0b-4eb8-961d-9ccf1dc918d8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:47.891293 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a42f25f9-ff0b-4eb8-961d-9ccf1dc918d8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:48.051620 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a42f25f9-ff0b-4eb8-961d-9ccf1dc918d8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:48.060576 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a42f25f9-ff0b-4eb8-961d-9ccf1dc918d8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:48.062991 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a42f25f9-ff0b-4eb8-961d-9ccf1dc918d8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:48.064155 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a42f25f9-ff0b-4eb8-961d-9ccf1dc918d8 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.200443 May 13 13:31:48.064709 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 440/856] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:47 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:49.091355 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-40592393-3a3b-49c8-9d70-146706730e6e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:49.092919 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-40592393-3a3b-49c8-9d70-146706730e6e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:49.108498 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-40592393-3a3b-49c8-9d70-146706730e6e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:49.108498 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-40592393-3a3b-49c8-9d70-146706730e6e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:49.108498 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-40592393-3a3b-49c8-9d70-146706730e6e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:49.108773 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-40592393-3a3b-49c8-9d70-146706730e6e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:49.254942 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-40592393-3a3b-49c8-9d70-146706730e6e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:49.263250 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-40592393-3a3b-49c8-9d70-146706730e6e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:49.264835 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-40592393-3a3b-49c8-9d70-146706730e6e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:49.266787 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-40592393-3a3b-49c8-9d70-146706730e6e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.182822 May 13 13:31:49.267772 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 441/857] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:49 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:31:50.285873 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ee510ca5-8602-4033-8f77-2728797bc23d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:50.286845 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ee510ca5-8602-4033-8f77-2728797bc23d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:50.295919 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ee510ca5-8602-4033-8f77-2728797bc23d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:50.296452 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ee510ca5-8602-4033-8f77-2728797bc23d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:50.298416 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ee510ca5-8602-4033-8f77-2728797bc23d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:50.298634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ee510ca5-8602-4033-8f77-2728797bc23d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:50.508978 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ee510ca5-8602-4033-8f77-2728797bc23d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:50.519118 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ee510ca5-8602-4033-8f77-2728797bc23d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:50.520684 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ee510ca5-8602-4033-8f77-2728797bc23d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:50.521850 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ee510ca5-8602-4033-8f77-2728797bc23d tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.241167 May 13 13:31:50.522422 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 442/858] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:50 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:31:50.998128 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6e4c556e-7bdb-4439-8218-f0a6e1e393cc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "POST /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.119973 May 13 13:31:51.001379 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 417/859] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:31:42 2022] POST /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments => generated 194 bytes in 8124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:51.542022 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e2d1a3bd-dbaa-4e27-8941-fe60fdeae680 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:51.542022 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e2d1a3bd-dbaa-4e27-8941-fe60fdeae680 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:51.548751 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2d1a3bd-dbaa-4e27-8941-fe60fdeae680 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:51.550041 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2d1a3bd-dbaa-4e27-8941-fe60fdeae680 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:51.551006 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2d1a3bd-dbaa-4e27-8941-fe60fdeae680 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:51.551754 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2d1a3bd-dbaa-4e27-8941-fe60fdeae680 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:51.717133 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e2d1a3bd-dbaa-4e27-8941-fe60fdeae680 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:51.725657 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e2d1a3bd-dbaa-4e27-8941-fe60fdeae680 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:51.727428 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e2d1a3bd-dbaa-4e27-8941-fe60fdeae680 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:51.728886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e2d1a3bd-dbaa-4e27-8941-fe60fdeae680 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.192272 May 13 13:31:51.740676 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 443/860] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:51 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:52.748675 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-693117e5-c3d1-43ce-852e-7ce2e20c24dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:52.749487 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-693117e5-c3d1-43ce-852e-7ce2e20c24dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:52.756922 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-693117e5-c3d1-43ce-852e-7ce2e20c24dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:52.757383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-693117e5-c3d1-43ce-852e-7ce2e20c24dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:52.758209 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-693117e5-c3d1-43ce-852e-7ce2e20c24dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:52.758653 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-693117e5-c3d1-43ce-852e-7ce2e20c24dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:52.958427 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-693117e5-c3d1-43ce-852e-7ce2e20c24dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:52.966650 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-693117e5-c3d1-43ce-852e-7ce2e20c24dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:52.968175 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-693117e5-c3d1-43ce-852e-7ce2e20c24dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:52.969370 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-693117e5-c3d1-43ce-852e-7ce2e20c24dc tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.225463 May 13 13:31:52.970184 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 418/861] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:52 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:53.428592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-8cb9461e-463e-40bc-a126-e63ba58088e1 req-f0fa7984-ff34-451b-ba88-29e81308fce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3", "name": "network-vif-plugged", "status": "completed", "tag": "ed34b0e2-4b0c-4721-9e85-8167943bb597"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:53.451171 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-8cb9461e-463e-40bc-a126-e63ba58088e1 req-f0fa7984-ff34-451b-ba88-29e81308fce7 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:53.452478 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-8cb9461e-463e-40bc-a126-e63ba58088e1 req-f0fa7984-ff34-451b-ba88-29e81308fce7 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:53.468234 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-8cb9461e-463e-40bc-a126-e63ba58088e1 req-f0fa7984-ff34-451b-ba88-29e81308fce7 service nova] Creating event network-vif-plugged:ed34b0e2-4b0c-4721-9e85-8167943bb597 for instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 on hv-cinder-84159 May 13 13:31:53.474383 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-8cb9461e-463e-40bc-a126-e63ba58088e1 req-f0fa7984-ff34-451b-ba88-29e81308fce7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052834 May 13 13:31:53.475941 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 444/862] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:53.988798 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0d0f2088-6675-408b-ae2b-fafe1abeec42 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:53.989406 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0d0f2088-6675-408b-ae2b-fafe1abeec42 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:53.996195 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0d0f2088-6675-408b-ae2b-fafe1abeec42 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:53.996904 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0d0f2088-6675-408b-ae2b-fafe1abeec42 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:53.997894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0d0f2088-6675-408b-ae2b-fafe1abeec42 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:53.998518 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0d0f2088-6675-408b-ae2b-fafe1abeec42 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:54.148232 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0d0f2088-6675-408b-ae2b-fafe1abeec42 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:54.159497 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0d0f2088-6675-408b-ae2b-fafe1abeec42 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:54.161059 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0d0f2088-6675-408b-ae2b-fafe1abeec42 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:54.162362 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0d0f2088-6675-408b-ae2b-fafe1abeec42 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.178088 May 13 13:31:54.163083 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 419/863] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:53 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:55.184006 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b3405a02-47bd-4d3e-b823-51125e9675fd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:55.184722 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b3405a02-47bd-4d3e-b823-51125e9675fd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:55.201476 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3405a02-47bd-4d3e-b823-51125e9675fd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:55.202228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3405a02-47bd-4d3e-b823-51125e9675fd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:55.203076 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3405a02-47bd-4d3e-b823-51125e9675fd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:55.203524 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b3405a02-47bd-4d3e-b823-51125e9675fd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:55.413159 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b3405a02-47bd-4d3e-b823-51125e9675fd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:55.422465 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b3405a02-47bd-4d3e-b823-51125e9675fd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:55.424405 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b3405a02-47bd-4d3e-b823-51125e9675fd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:55.425936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b3405a02-47bd-4d3e-b823-51125e9675fd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.248878 May 13 13:31:55.426935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 445/864] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:55 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:55.519106 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-47548c98-5566-4901-ae88-6d0083bf5a19 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Action: 'create', calling method: .version_select at 0x7faaa1deaca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2146808143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4dUv0U8+uXVioy0+qykr/EInalloLkly29rMBTZw27paL3eM75ZkfeQXm0dbnCCBGUwoSLQUUTqap6RHeYwibH1AgP8m/Qm8/UDkkmMyQ4ssrii3g+BfL6wk3Aiz1joA=="}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:31:55.533106 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-47548c98-5566-4901-ae88-6d0083bf5a19 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Getting quotas for project 0b1cc4c699be4edfa243bc7dde91cd51. Resources: {'key_pairs'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:31:55.537218 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-47548c98-5566-4901-ae88-6d0083bf5a19 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Getting quotas for user 9c6a8bd3014349a3aa60c9471f3c8234 and project 0b1cc4c699be4edfa243bc7dde91cd51. Resources: {'key_pairs'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:31:55.614965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-47548c98-5566-4901-ae88-6d0083bf5a19 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.321290 May 13 13:31:55.615599 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 420/865] 10.222.0.25 () {60 vars in 1158 bytes} [Fri May 13 13:31:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:31:56.444387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-01561162-0669-4aae-8235-bb4c6c65f4df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:56.445002 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-01561162-0669-4aae-8235-bb4c6c65f4df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:56.452917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-01561162-0669-4aae-8235-bb4c6c65f4df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:56.452917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-01561162-0669-4aae-8235-bb4c6c65f4df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:56.452917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-01561162-0669-4aae-8235-bb4c6c65f4df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:56.453222 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-01561162-0669-4aae-8235-bb4c6c65f4df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:56.619983 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-01561162-0669-4aae-8235-bb4c6c65f4df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:56.628686 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-01561162-0669-4aae-8235-bb4c6c65f4df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:56.631156 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-01561162-0669-4aae-8235-bb4c6c65f4df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:56.632557 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-01561162-0669-4aae-8235-bb4c6c65f4df tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1733 microversion: 2.20 time: 0.192082 May 13 13:31:56.633123 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 446/866] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:56 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1733 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:57.651731 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0b279610-7703-4bf4-bf8a-9c1fd532fc80 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:57.652356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0b279610-7703-4bf4-bf8a-9c1fd532fc80 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:57.660440 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0b279610-7703-4bf4-bf8a-9c1fd532fc80 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:57.660900 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0b279610-7703-4bf4-bf8a-9c1fd532fc80 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:57.661689 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0b279610-7703-4bf4-bf8a-9c1fd532fc80 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:57.662174 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0b279610-7703-4bf4-bf8a-9c1fd532fc80 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:57.801532 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0b279610-7703-4bf4-bf8a-9c1fd532fc80 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:57.809391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0b279610-7703-4bf4-bf8a-9c1fd532fc80 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:57.810945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0b279610-7703-4bf4-bf8a-9c1fd532fc80 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:31:57.812120 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0b279610-7703-4bf4-bf8a-9c1fd532fc80 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1720 microversion: 2.20 time: 0.164705 May 13 13:31:57.824758 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 421/867] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:31:57 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:31:58.677183 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3d9c2961-6aaa-4323-a9b1-9c9659823272 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:58.678229 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3d9c2961-6aaa-4323-a9b1-9c9659823272 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:58.684501 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3d9c2961-6aaa-4323-a9b1-9c9659823272 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:58.685176 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3d9c2961-6aaa-4323-a9b1-9c9659823272 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:58.686197 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3d9c2961-6aaa-4323-a9b1-9c9659823272 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:58.686828 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3d9c2961-6aaa-4323-a9b1-9c9659823272 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:58.719151 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3d9c2961-6aaa-4323-a9b1-9c9659823272 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045924 May 13 13:31:58.720102 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 447/868] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:31:58 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:58.862914 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-25e54a23-0e9d-4f1a-80a8-4ce6d09c5c82 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:58.863429 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-25e54a23-0e9d-4f1a-80a8-4ce6d09c5c82 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:58.869945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-25e54a23-0e9d-4f1a-80a8-4ce6d09c5c82 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:58.870410 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-25e54a23-0e9d-4f1a-80a8-4ce6d09c5c82 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:58.871218 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-25e54a23-0e9d-4f1a-80a8-4ce6d09c5c82 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:58.871650 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-25e54a23-0e9d-4f1a-80a8-4ce6d09c5c82 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:58.901696 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-25e54a23-0e9d-4f1a-80a8-4ce6d09c5c82 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments/b7ced73c-6137-41e9-9513-6beb200ab7da" status: 200 len: 194 microversion: 2.1 time: 0.043258 May 13 13:31:58.902729 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 422/869] 10.222.0.25 () {58 vars in 1412 bytes} [Fri May 13 13:31:58 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments/b7ced73c-6137-41e9-9513-6beb200ab7da => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:31:58.913658 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e9f46fd9-6758-412a-8145-5190e31f574f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:31:58.917115 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e9f46fd9-6758-412a-8145-5190e31f574f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:31:58.920300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9f46fd9-6758-412a-8145-5190e31f574f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:58.920756 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9f46fd9-6758-412a-8145-5190e31f574f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:58.921542 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9f46fd9-6758-412a-8145-5190e31f574f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:31:58.922534 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e9f46fd9-6758-412a-8145-5190e31f574f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:31:59.011221 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-e9f46fd9-6758-412a-8145-5190e31f574f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lazy-loading 'services' on Instance uuid 86a8fab2-8f7c-4abf-8c09-b09f33719545 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:31:59.242874 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e9f46fd9-6758-412a-8145-5190e31f574f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments/b7ced73c-6137-41e9-9513-6beb200ab7da" status: 202 len: 0 microversion: 2.1 time: 0.332994 May 13 13:31:59.250875 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 448/870] 10.222.0.25 () {58 vars in 1415 bytes} [Fri May 13 13:31:58 2022] DELETE /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments/b7ced73c-6137-41e9-9513-6beb200ab7da => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:32:00.989623 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2d8293f3-cfdf-45cd-b342-ca2bbafbc277 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:00.990218 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2d8293f3-cfdf-45cd-b342-ca2bbafbc277 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:00.996424 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2d8293f3-cfdf-45cd-b342-ca2bbafbc277 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:00.996882 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2d8293f3-cfdf-45cd-b342-ca2bbafbc277 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:00.997659 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2d8293f3-cfdf-45cd-b342-ca2bbafbc277 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:00.998138 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2d8293f3-cfdf-45cd-b342-ca2bbafbc277 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:01.024977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2d8293f3-cfdf-45cd-b342-ca2bbafbc277 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Going to try to terminate instance {{(pid=117602) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:32:01.350660 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2d8293f3-cfdf-45cd-b342-ca2bbafbc277 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 204 len: 0 microversion: 2.1 time: 0.364626 May 13 13:32:01.353321 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 423/871] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:32:00 2022] DELETE /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:32:01.361281 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fbc756cf-706c-4bdf-856d-bdc5eb86095b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:01.362285 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fbc756cf-706c-4bdf-856d-bdc5eb86095b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:01.368595 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fbc756cf-706c-4bdf-856d-bdc5eb86095b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:01.369038 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fbc756cf-706c-4bdf-856d-bdc5eb86095b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:01.383268 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fbc756cf-706c-4bdf-856d-bdc5eb86095b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:01.383268 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fbc756cf-706c-4bdf-856d-bdc5eb86095b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:01.427464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1b0d1b03-6afd-4869-b6f8-d66d9d3bf91f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:01.428158 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1b0d1b03-6afd-4869-b6f8-d66d9d3bf91f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:01.434355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1b0d1b03-6afd-4869-b6f8-d66d9d3bf91f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:01.434799 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1b0d1b03-6afd-4869-b6f8-d66d9d3bf91f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:01.435571 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1b0d1b03-6afd-4869-b6f8-d66d9d3bf91f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:01.436019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1b0d1b03-6afd-4869-b6f8-d66d9d3bf91f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:01.466180 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1b0d1b03-6afd-4869-b6f8-d66d9d3bf91f tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments/6a97eb94-52d3-4a4a-b395-c4acf72d0882" status: 200 len: 194 microversion: 2.1 time: 0.042923 May 13 13:32:01.466762 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 424/872] 10.222.0.25 () {58 vars in 1412 bytes} [Fri May 13 13:32:01 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments/6a97eb94-52d3-4a4a-b395-c4acf72d0882 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:01.477157 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e9b4b2dc-a278-4dff-bb14-a956f62c70c9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:01.477585 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e9b4b2dc-a278-4dff-bb14-a956f62c70c9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:01.483881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e9b4b2dc-a278-4dff-bb14-a956f62c70c9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:01.484341 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e9b4b2dc-a278-4dff-bb14-a956f62c70c9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:01.485722 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e9b4b2dc-a278-4dff-bb14-a956f62c70c9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:01.486281 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e9b4b2dc-a278-4dff-bb14-a956f62c70c9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:01.517560 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fbc756cf-706c-4bdf-856d-bdc5eb86095b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:01.525634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fbc756cf-706c-4bdf-856d-bdc5eb86095b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1577 microversion: 2.1 time: 0.169622 May 13 13:32:01.526416 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 449/873] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:01 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:01.572122 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-e9b4b2dc-a278-4dff-bb14-a956f62c70c9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lazy-loading 'services' on Instance uuid 86a8fab2-8f7c-4abf-8c09-b09f33719545 {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:32:01.812941 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e9b4b2dc-a278-4dff-bb14-a956f62c70c9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments/6a97eb94-52d3-4a4a-b395-c4acf72d0882" status: 202 len: 0 microversion: 2.1 time: 0.339573 May 13 13:32:01.813540 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 425/874] 10.222.0.25 () {58 vars in 1415 bytes} [Fri May 13 13:32:01 2022] DELETE /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments/6a97eb94-52d3-4a4a-b395-c4acf72d0882 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:32:02.543602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-58f82bf9-c07e-4351-ba8e-9df4dd6e7559 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:02.544213 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-58f82bf9-c07e-4351-ba8e-9df4dd6e7559 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:02.550611 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-58f82bf9-c07e-4351-ba8e-9df4dd6e7559 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:02.551066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-58f82bf9-c07e-4351-ba8e-9df4dd6e7559 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:02.551834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-58f82bf9-c07e-4351-ba8e-9df4dd6e7559 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:02.552275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-58f82bf9-c07e-4351-ba8e-9df4dd6e7559 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:02.684726 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-58f82bf9-c07e-4351-ba8e-9df4dd6e7559 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:02.692722 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-58f82bf9-c07e-4351-ba8e-9df4dd6e7559 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1577 microversion: 2.1 time: 0.153092 May 13 13:32:02.693321 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 450/875] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:02 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:03.712031 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6ac7fe72-9a69-47c8-9b76-2a97619caa05 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:03.712656 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6ac7fe72-9a69-47c8-9b76-2a97619caa05 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:03.720060 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6ac7fe72-9a69-47c8-9b76-2a97619caa05 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:03.720515 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6ac7fe72-9a69-47c8-9b76-2a97619caa05 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:03.721299 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6ac7fe72-9a69-47c8-9b76-2a97619caa05 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:03.726224 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6ac7fe72-9a69-47c8-9b76-2a97619caa05 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:03.868107 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6ac7fe72-9a69-47c8-9b76-2a97619caa05 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:03.876294 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6ac7fe72-9a69-47c8-9b76-2a97619caa05 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1577 microversion: 2.1 time: 0.169499 May 13 13:32:03.876858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 426/876] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:03 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:04.035175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a5c87e64-b5d4-4c10-9861-7872592e93bc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:04.036281 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a5c87e64-b5d4-4c10-9861-7872592e93bc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:04.043041 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a5c87e64-b5d4-4c10-9861-7872592e93bc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.043506 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a5c87e64-b5d4-4c10-9861-7872592e93bc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.044302 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a5c87e64-b5d4-4c10-9861-7872592e93bc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.044749 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a5c87e64-b5d4-4c10-9861-7872592e93bc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.076050 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a5c87e64-b5d4-4c10-9861-7872592e93bc tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044752 May 13 13:32:04.076655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 451/877] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:32:04 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:32:04.181866 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4468860b-2d70-4fea-b560-e0bc4d95f0ae tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:04.182868 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-4468860b-2d70-4fea-b560-e0bc4d95f0ae tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:04.189533 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4468860b-2d70-4fea-b560-e0bc4d95f0ae tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.190043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4468860b-2d70-4fea-b560-e0bc4d95f0ae tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.190841 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4468860b-2d70-4fea-b560-e0bc4d95f0ae tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.191275 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4468860b-2d70-4fea-b560-e0bc4d95f0ae tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.227739 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4468860b-2d70-4fea-b560-e0bc4d95f0ae tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049718 May 13 13:32:04.228323 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 427/878] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:32:04 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:32:04.294050 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0703f89f-7fd2-43a8-b435-e9f44f69508b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:04.294549 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0703f89f-7fd2-43a8-b435-e9f44f69508b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:04.309257 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0703f89f-7fd2-43a8-b435-e9f44f69508b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.309257 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0703f89f-7fd2-43a8-b435-e9f44f69508b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.309257 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0703f89f-7fd2-43a8-b435-e9f44f69508b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.309257 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0703f89f-7fd2-43a8-b435-e9f44f69508b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.334397 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0703f89f-7fd2-43a8-b435-e9f44f69508b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:32:04.599907 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-09972e8d-f0e9-4bea-8de6-25dc836ec7c6 req-dc9079e8-1b2b-4881-8630-8651319e2278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c", "name": "network-vif-deleted", "tag": "d1cd2559-b1b4-466c-9ab5-45773dffdb54"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:04.611116 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-09972e8d-f0e9-4bea-8de6-25dc836ec7c6 req-dc9079e8-1b2b-4881-8630-8651319e2278 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.611568 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-09972e8d-f0e9-4bea-8de6-25dc836ec7c6 req-dc9079e8-1b2b-4881-8630-8651319e2278 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.624995 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-09972e8d-f0e9-4bea-8de6-25dc836ec7c6 req-dc9079e8-1b2b-4881-8630-8651319e2278 service nova] Creating event network-vif-deleted:d1cd2559-b1b4-466c-9ab5-45773dffdb54 for instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c on hv-cinder-84159 May 13 13:32:04.628171 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-09972e8d-f0e9-4bea-8de6-25dc836ec7c6 req-dc9079e8-1b2b-4881-8630-8651319e2278 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 May 13 13:32:04.628774 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 428/879] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:04.688202 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0703f89f-7fd2-43a8-b435-e9f44f69508b tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 204 len: 0 microversion: 2.1 time: 0.397672 May 13 13:32:04.688828 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 452/880] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:32:04 2022] DELETE /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:32:04.697676 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-dd74edf3-f7e3-4f9d-a309-ebdbadff3534 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:04.698436 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-dd74edf3-f7e3-4f9d-a309-ebdbadff3534 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:04.705135 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dd74edf3-f7e3-4f9d-a309-ebdbadff3534 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.705483 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dd74edf3-f7e3-4f9d-a309-ebdbadff3534 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.706792 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dd74edf3-f7e3-4f9d-a309-ebdbadff3534 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.710164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dd74edf3-f7e3-4f9d-a309-ebdbadff3534 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.847472 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-dd74edf3-f7e3-4f9d-a309-ebdbadff3534 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:04.855577 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-dd74edf3-f7e3-4f9d-a309-ebdbadff3534 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1672 microversion: 2.1 time: 0.162091 May 13 13:32:04.856333 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 429/881] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:04 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:04.895151 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f54263dd-213a-40c8-af09-658af90f0f66 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:04.895859 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f54263dd-213a-40c8-af09-658af90f0f66 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:04.901937 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f54263dd-213a-40c8-af09-658af90f0f66 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.902386 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f54263dd-213a-40c8-af09-658af90f0f66 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.903343 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f54263dd-213a-40c8-af09-658af90f0f66 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:04.903783 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f54263dd-213a-40c8-af09-658af90f0f66 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:04.974542 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f54263dd-213a-40c8-af09-658af90f0f66 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:04.981915 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f54263dd-213a-40c8-af09-658af90f0f66 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1226 microversion: 2.1 time: 0.091017 May 13 13:32:04.982567 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 453/882] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:04 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:05.873069 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-29f51d74-8e88-46a2-8482-bd38abcc69e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:05.873612 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-29f51d74-8e88-46a2-8482-bd38abcc69e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:05.881242 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-29f51d74-8e88-46a2-8482-bd38abcc69e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:05.881707 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-29f51d74-8e88-46a2-8482-bd38abcc69e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:05.882914 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-29f51d74-8e88-46a2-8482-bd38abcc69e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:05.883387 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-29f51d74-8e88-46a2-8482-bd38abcc69e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:05.999376 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-279362f7-8455-4813-acea-036fae0bbf26 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:06.000011 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-279362f7-8455-4813-acea-036fae0bbf26 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:06.006309 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-279362f7-8455-4813-acea-036fae0bbf26 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:06.006761 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-279362f7-8455-4813-acea-036fae0bbf26 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:06.016060 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-279362f7-8455-4813-acea-036fae0bbf26 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:06.016060 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-279362f7-8455-4813-acea-036fae0bbf26 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:06.021163 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-29f51d74-8e88-46a2-8482-bd38abcc69e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:06.028489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-29f51d74-8e88-46a2-8482-bd38abcc69e5 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1672 microversion: 2.1 time: 0.159399 May 13 13:32:06.029055 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 430/883] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:05 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:06.070224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-279362f7-8455-4813-acea-036fae0bbf26 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:06.078222 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-279362f7-8455-4813-acea-036fae0bbf26 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1226 microversion: 2.1 time: 0.083096 May 13 13:32:06.078817 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 454/884] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:05 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:07.046138 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3960f2d2-cd92-4f47-8614-06036ede99e6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:07.046814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3960f2d2-cd92-4f47-8614-06036ede99e6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:07.053753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3960f2d2-cd92-4f47-8614-06036ede99e6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:07.053753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3960f2d2-cd92-4f47-8614-06036ede99e6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:07.063940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3960f2d2-cd92-4f47-8614-06036ede99e6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:07.064394 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3960f2d2-cd92-4f47-8614-06036ede99e6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:07.096093 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d1084843-5ef9-4533-b56f-dba9e1a4042f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:07.097416 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d1084843-5ef9-4533-b56f-dba9e1a4042f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:07.113474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d1084843-5ef9-4533-b56f-dba9e1a4042f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:07.114265 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d1084843-5ef9-4533-b56f-dba9e1a4042f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:07.115251 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d1084843-5ef9-4533-b56f-dba9e1a4042f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:07.115794 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d1084843-5ef9-4533-b56f-dba9e1a4042f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:07.152180 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d1084843-5ef9-4533-b56f-dba9e1a4042f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:07.152707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d1084843-5ef9-4533-b56f-dba9e1a4042f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:07.153258 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-d1084843-5ef9-4533-b56f-dba9e1a4042f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lazy-loading 'fault' on Instance uuid ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:32:07.205651 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d1084843-5ef9-4533-b56f-dba9e1a4042f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:07.213981 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3960f2d2-cd92-4f47-8614-06036ede99e6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:07.216693 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d1084843-5ef9-4533-b56f-dba9e1a4042f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 200 len: 1231 microversion: 2.1 time: 0.124922 May 13 13:32:07.217619 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 455/885] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:07 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 1231 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:07.224730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3960f2d2-cd92-4f47-8614-06036ede99e6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1672 microversion: 2.1 time: 0.182435 May 13 13:32:07.225385 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 431/886] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:07 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1672 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:07.650932 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d10122ce-88fb-4461-8d52-d80b232a427c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:07.654527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d10122ce-88fb-4461-8d52-d80b232a427c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:07.661575 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d10122ce-88fb-4461-8d52-d80b232a427c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:07.663090 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d10122ce-88fb-4461-8d52-d80b232a427c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:07.664077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d10122ce-88fb-4461-8d52-d80b232a427c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:07.664488 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d10122ce-88fb-4461-8d52-d80b232a427c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:07.689225 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d10122ce-88fb-4461-8d52-d80b232a427c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/ips" status: 200 len: 150 microversion: 2.1 time: 0.042291 May 13 13:32:07.695143 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 456/887] 10.222.0.25 () {58 vars in 1247 bytes} [Fri May 13 13:32:07 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:07.811740 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-3f8162e1-6f51-45c6-864a-31ff6acba42b req-df80fc0e-4786-4270-981f-361dd9d5d177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a8fab2-8f7c-4abf-8c09-b09f33719545", "name": "network-vif-deleted", "tag": "093f7cfd-0126-49c6-9c1c-b42a1adde880"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:07.820973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-3f8162e1-6f51-45c6-864a-31ff6acba42b req-df80fc0e-4786-4270-981f-361dd9d5d177 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:07.821628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-3f8162e1-6f51-45c6-864a-31ff6acba42b req-df80fc0e-4786-4270-981f-361dd9d5d177 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:07.841068 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-3f8162e1-6f51-45c6-864a-31ff6acba42b req-df80fc0e-4786-4270-981f-361dd9d5d177 service nova] Creating event network-vif-deleted:093f7cfd-0126-49c6-9c1c-b42a1adde880 for instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 on hv-cinder-84159 May 13 13:32:07.847176 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-3f8162e1-6f51-45c6-864a-31ff6acba42b req-df80fc0e-4786-4270-981f-361dd9d5d177 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039029 May 13 13:32:07.848438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 432/888] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:08.238512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0eedc74b-6a6f-4c2d-83a5-a513b4aa3a34 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:08.239132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0eedc74b-6a6f-4c2d-83a5-a513b4aa3a34 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:08.242870 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f072d374-3a6b-4275-962f-f344d3fbe7c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:08.244131 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f072d374-3a6b-4275-962f-f344d3fbe7c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:08.246167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0eedc74b-6a6f-4c2d-83a5-a513b4aa3a34 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:08.246809 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0eedc74b-6a6f-4c2d-83a5-a513b4aa3a34 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:08.247609 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0eedc74b-6a6f-4c2d-83a5-a513b4aa3a34 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:08.248051 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0eedc74b-6a6f-4c2d-83a5-a513b4aa3a34 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:08.252390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f072d374-3a6b-4275-962f-f344d3fbe7c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:08.252864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f072d374-3a6b-4275-962f-f344d3fbe7c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:08.253705 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f072d374-3a6b-4275-962f-f344d3fbe7c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:08.254356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f072d374-3a6b-4275-962f-f344d3fbe7c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:08.263333 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-0eedc74b-6a6f-4c2d-83a5-a513b4aa3a34 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] HTTP exception thrown: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0eedc74b-6a6f-4c2d-83a5-a513b4aa3a34 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Request method failure captured: May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c HTTP/1.1 May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABifl0Ldqd3Ptm-EdnlZvTnFjfNDL5CRXv0uvRwNi0XJjxbcN2McQxHJGfsogevDH5Xpt722-Fty6tkZpt8j5wEAIfligjzpBd82XfNZqMIlIcYhxK7eYv3-IzbvPlKxrDN8qpRiM8GczxZ-PSIXIRpk7cwLdzBTPn2onqx--9izh_De4Y May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: d3e32e04d1f44e97b903f98c7c2749db May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-TestVolumeBootPattern-480963567 May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:32:08.265277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:32:08.267300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3e32e04d1f44e97b903f98c7c2749db", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:32:08.267300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-TestVolumeBootPattern-480963567 May 13 13:32:08.267300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: d3e32e04d1f44e97b903f98c7c2749db May 13 13:32:08.267300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-TestVolumeBootPattern-480963567 May 13 13:32:08.267300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-TestVolumeBootPattern-480963567-project May 13 13:32:08.267300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:32:08.267300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:32:08.267300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 8101850dd18f4108ac12ff9487cbbe3e May 13 13:32:08.267300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-TestVolumeBootPattern-480963567-project May 13 13:32:08.267300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:32:08.267300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:32:08.267300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c'} May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:08.268194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:32:08.269667 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:08.271264 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0eedc74b-6a6f-4c2d-83a5-a513b4aa3a34 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Returning 404 to user: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:08.271728 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0eedc74b-6a6f-4c2d-83a5-a513b4aa3a34 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 404 len: 111 microversion: 2.1 time: 0.038973 May 13 13:32:08.272479 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 457/889] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:08 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:32:08.291413 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f072d374-3a6b-4275-962f-f344d3fbe7c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:08.291848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f072d374-3a6b-4275-962f-f344d3fbe7c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:08.292318 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-f072d374-3a6b-4275-962f-f344d3fbe7c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lazy-loading 'fault' on Instance uuid 86a8fab2-8f7c-4abf-8c09-b09f33719545 {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:32:08.340989 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f072d374-3a6b-4275-962f-f344d3fbe7c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '233f5342cf334c7689cb9e71f4fbaab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915a7ff1f6d64480a08c38e762da4134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:08.348993 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f072d374-3a6b-4275-962f-f344d3fbe7c8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 200 len: 1327 microversion: 2.1 time: 0.110653 May 13 13:32:08.349830 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 433/890] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:08 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:08.398028 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-640000029", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1357767532", "security_groups": [{"name": "tempest-secgroup-smoke-854436485"}], "block_device_mapping_v2": [{"uuid": "2c5c503b-159b-4d19-8a00-fe8ee658985e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c9600aa-af97-422e-b469-899e3d008792"}]}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:08.555693 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] validate_networks() for [('6c9600aa-af97-422e-b469-899e3d008792', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:32:08.990740 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:32:08.991171 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:32:08.991661 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:32:08.992157 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:32:08.992557 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:32:09.001177 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:09.001568 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:09.002446 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:09.002917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:09.019117 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Getting quotas for project d3e32e04d1f44e97b903f98c7c2749db. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:32:09.023367 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Getting quotas for user 8101850dd18f4108ac12ff9487cbbe3e and project d3e32e04d1f44e97b903f98c7c2749db. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:32:09.087782 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:32:09.089886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c5c503b-159b-4d19-8a00-fe8ee658985e',volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:32:09.366853 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c97ff553-4c54-42c5-9de2-918f88bf86aa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:09.367500 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c97ff553-4c54-42c5-9de2-918f88bf86aa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:09.374286 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c97ff553-4c54-42c5-9de2-918f88bf86aa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:09.374742 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c97ff553-4c54-42c5-9de2-918f88bf86aa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:09.375534 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c97ff553-4c54-42c5-9de2-918f88bf86aa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:09.375974 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c97ff553-4c54-42c5-9de2-918f88bf86aa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:09.391730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-c97ff553-4c54-42c5-9de2-918f88bf86aa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] HTTP exception thrown: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c97ff553-4c54-42c5-9de2-918f88bf86aa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Request method failure captured: May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 HTTP/1.1 May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflxDsrR31d-SIPD1D4egqJyf_jEs09f36p1mrqUfLT1xjmNSuYYzyE2vQ4C6DwTgEOSOnnkEC356p4RUfAO2l28KjPny4Rw_8RIFFB5LVj3w3gniM-a-g0rkXENFpzhgwelNJ4jja7MX52P9WxDDeZs9AjEoJQhEZAiivYDURiGU3YQ May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 915a7ff1f6d64480a08c38e762da4134 May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:32:09.393391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:32:09.394982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_915a7ff1f6d64480a08c38e762da4134", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:32:09.394982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:09.394982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 915a7ff1f6d64480a08c38e762da4134 May 13 13:32:09.394982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:09.394982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeTestJSON-961764179-project May 13 13:32:09.394982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:32:09.394982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:32:09.394982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 233f5342cf334c7689cb9e71f4fbaab3 May 13 13:32:09.394982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeTestJSON-961764179-project May 13 13:32:09.394982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:32:09.394982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:09.394982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '86a8fab2-8f7c-4abf-8c09-b09f33719545'} May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:09.395916 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:09.397980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:09.399466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c97ff553-4c54-42c5-9de2-918f88bf86aa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Returning 404 to user: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:09.399466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c97ff553-4c54-42c5-9de2-918f88bf86aa tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 404 len: 111 microversion: 2.1 time: 0.032095 May 13 13:32:09.399466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 434/891] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:09 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:32:09.403209 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-263e6ec2-d8e0-4d45-892e-2d084208241e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '.version_select at 0x7faaa1ebda60>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:09.518207 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-263e6ec2-d8e0-4d45-892e-2d084208241e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040526730" status: 202 len: 0 microversion: 2.1 time: 0.118371 May 13 13:32:09.518789 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 435/892] 10.222.0.25 () {58 vars in 1220 bytes} [Fri May 13 13:32:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1040526730 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:32:09.603274 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-08c5405d-96f6-499e-a256-dfc2beac83ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f457fc60-31de-4afa-ae99-1f2af8b8275d"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:09.604477 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-08c5405d-96f6-499e-a256-dfc2beac83ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:09.611757 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-08c5405d-96f6-499e-a256-dfc2beac83ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:09.612304 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-08c5405d-96f6-499e-a256-dfc2beac83ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:09.623283 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-08c5405d-96f6-499e-a256-dfc2beac83ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:09.623283 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-08c5405d-96f6-499e-a256-dfc2beac83ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:09.627323 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ebd0d36d-aa1c-425b-83ad-8d905bccf70f tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.233172 May 13 13:32:09.628540 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 458/893] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:32:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:32:09.638799 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fc1acf72-313a-4746-b176-41ebc0256706 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:09.639676 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fc1acf72-313a-4746-b176-41ebc0256706 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:09.718485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fc1acf72-313a-4746-b176-41ebc0256706 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:09.718485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fc1acf72-313a-4746-b176-41ebc0256706 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1094 microversion: 2.1 time: 0.078176 May 13 13:32:09.718485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 459/894] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:09 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:10.697748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-08c5405d-96f6-499e-a256-dfc2beac83ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.098299 May 13 13:32:10.698989 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 436/895] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:32:09 2022] POST /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments => generated 194 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:32:10.730967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9507e6e5-c412-4d41-88c7-91a0402044b7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:10.731537 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9507e6e5-c412-4d41-88c7-91a0402044b7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:10.738775 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9507e6e5-c412-4d41-88c7-91a0402044b7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:10.742570 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9507e6e5-c412-4d41-88c7-91a0402044b7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:10.742570 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9507e6e5-c412-4d41-88c7-91a0402044b7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:10.742570 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9507e6e5-c412-4d41-88c7-91a0402044b7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:10.811471 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9507e6e5-c412-4d41-88c7-91a0402044b7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:10.819277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9507e6e5-c412-4d41-88c7-91a0402044b7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1144 microversion: 2.1 time: 0.092614 May 13 13:32:10.824568 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 460/896] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:10 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:11.837503 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-dfa81ef4-af0d-4448-ae8b-bcfc25a43531 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:11.841601 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-dfa81ef4-af0d-4448-ae8b-bcfc25a43531 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:11.844893 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dfa81ef4-af0d-4448-ae8b-bcfc25a43531 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:11.845349 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dfa81ef4-af0d-4448-ae8b-bcfc25a43531 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:11.846159 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dfa81ef4-af0d-4448-ae8b-bcfc25a43531 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:11.846598 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-dfa81ef4-af0d-4448-ae8b-bcfc25a43531 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:11.911099 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-dfa81ef4-af0d-4448-ae8b-bcfc25a43531 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:11.918485 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-dfa81ef4-af0d-4448-ae8b-bcfc25a43531 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1192 microversion: 2.1 time: 0.085880 May 13 13:32:11.922424 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 437/897] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:11 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:12.939974 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-511ae579-ee58-4bf9-913e-730fdf8f8412 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:12.939974 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-511ae579-ee58-4bf9-913e-730fdf8f8412 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:12.945539 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-511ae579-ee58-4bf9-913e-730fdf8f8412 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:12.946022 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-511ae579-ee58-4bf9-913e-730fdf8f8412 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:12.946799 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-511ae579-ee58-4bf9-913e-730fdf8f8412 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:12.947240 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-511ae579-ee58-4bf9-913e-730fdf8f8412 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:13.153216 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-511ae579-ee58-4bf9-913e-730fdf8f8412 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:13.165262 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-511ae579-ee58-4bf9-913e-730fdf8f8412 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1277 microversion: 2.1 time: 0.233251 May 13 13:32:13.166002 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 461/898] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:12 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:13.342378 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4f7d39e2-5da4-44d2-94fd-a1bd928131f9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:13.343428 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-4f7d39e2-5da4-44d2-94fd-a1bd928131f9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:13.349980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4f7d39e2-5da4-44d2-94fd-a1bd928131f9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:13.350433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4f7d39e2-5da4-44d2-94fd-a1bd928131f9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:13.351243 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4f7d39e2-5da4-44d2-94fd-a1bd928131f9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:13.351675 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-4f7d39e2-5da4-44d2-94fd-a1bd928131f9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:13.365601 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-4f7d39e2-5da4-44d2-94fd-a1bd928131f9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] HTTP exception thrown: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4f7d39e2-5da4-44d2-94fd-a1bd928131f9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Request method failure captured: May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: DELETE /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 HTTP/1.1 May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflxDsrR31d-SIPD1D4egqJyf_jEs09f36p1mrqUfLT1xjmNSuYYzyE2vQ4C6DwTgEOSOnnkEC356p4RUfAO2l28KjPny4Rw_8RIFFB5LVj3w3gniM-a-g0rkXENFpzhgwelNJ4jja7MX52P9WxDDeZs9AjEoJQhEZAiivYDURiGU3YQ May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 915a7ff1f6d64480a08c38e762da4134 May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:32:13.367369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:32:13.368972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_915a7ff1f6d64480a08c38e762da4134", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:32:13.368972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:13.368972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 915a7ff1f6d64480a08c38e762da4134 May 13 13:32:13.368972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:13.368972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeTestJSON-961764179-project May 13 13:32:13.368972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:32:13.368972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:32:13.368972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 233f5342cf334c7689cb9e71f4fbaab3 May 13 13:32:13.368972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeTestJSON-961764179-project May 13 13:32:13.368972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:32:13.368972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:13.368972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '86a8fab2-8f7c-4abf-8c09-b09f33719545'} May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:13.369945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:13.371211 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:13.372438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4f7d39e2-5da4-44d2-94fd-a1bd928131f9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Returning 404 to user: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:13.372438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4f7d39e2-5da4-44d2-94fd-a1bd928131f9 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 404 len: 111 microversion: 2.1 time: 0.030346 May 13 13:32:13.372438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 438/899] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:32:13 2022] DELETE /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:32:13.378391 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1d7175ff-aae2-4274-ab93-fbf6bc12edb8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:13.379003 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1d7175ff-aae2-4274-ab93-fbf6bc12edb8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 86a8fab2-8f7c-4abf-8c09-b09f33719545] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:13.385247 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1d7175ff-aae2-4274-ab93-fbf6bc12edb8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:13.385698 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1d7175ff-aae2-4274-ab93-fbf6bc12edb8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:13.386945 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1d7175ff-aae2-4274-ab93-fbf6bc12edb8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:13.386945 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1d7175ff-aae2-4274-ab93-fbf6bc12edb8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:13.401671 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-1d7175ff-aae2-4274-ab93-fbf6bc12edb8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] HTTP exception thrown: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1d7175ff-aae2-4274-ab93-fbf6bc12edb8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Request method failure captured: May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 HTTP/1.1 May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflxDsrR31d-SIPD1D4egqJyf_jEs09f36p1mrqUfLT1xjmNSuYYzyE2vQ4C6DwTgEOSOnnkEC356p4RUfAO2l28KjPny4Rw_8RIFFB5LVj3w3gniM-a-g0rkXENFpzhgwelNJ4jja7MX52P9WxDDeZs9AjEoJQhEZAiivYDURiGU3YQ May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 915a7ff1f6d64480a08c38e762da4134 May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:32:13.403244 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:32:13.405046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_915a7ff1f6d64480a08c38e762da4134", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:32:13.405046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:13.405046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 915a7ff1f6d64480a08c38e762da4134 May 13 13:32:13.405046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:13.405046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeTestJSON-961764179-project May 13 13:32:13.405046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:32:13.405046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:32:13.405046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 233f5342cf334c7689cb9e71f4fbaab3 May 13 13:32:13.405046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeTestJSON-961764179-project May 13 13:32:13.405046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:32:13.405046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:13.405046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '86a8fab2-8f7c-4abf-8c09-b09f33719545'} May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:13.405870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. May 13 13:32:13.407349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:13.408698 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1d7175ff-aae2-4274-ab93-fbf6bc12edb8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Returning 404 to user: Instance 86a8fab2-8f7c-4abf-8c09-b09f33719545 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:13.408698 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1d7175ff-aae2-4274-ab93-fbf6bc12edb8 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545" status: 404 len: 111 microversion: 2.1 time: 0.030726 May 13 13:32:13.408698 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 462/900] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:13 2022] GET /compute/v2.1/servers/86a8fab2-8f7c-4abf-8c09-b09f33719545 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:32:13.887714 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-d7487490-36b8-41b9-bbb3-b14f345a3500 req-ee6acfe2-19bc-4629-8025-1758c22affeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd189827-5e6a-43de-b4f7-e596ff7c1fe5", "tag": "4d81ea3d-1342-41f8-9505-45e355cea083"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:13.898166 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-d7487490-36b8-41b9-bbb3-b14f345a3500 req-ee6acfe2-19bc-4629-8025-1758c22affeb service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:13.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-d7487490-36b8-41b9-bbb3-b14f345a3500 req-ee6acfe2-19bc-4629-8025-1758c22affeb service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:13.926070 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-d7487490-36b8-41b9-bbb3-b14f345a3500 req-ee6acfe2-19bc-4629-8025-1758c22affeb service nova] Creating event network-changed:4d81ea3d-1342-41f8-9505-45e355cea083 for instance fd189827-5e6a-43de-b4f7-e596ff7c1fe5 on hv-cinder-84159 May 13 13:32:13.932396 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-d7487490-36b8-41b9-bbb3-b14f345a3500 req-ee6acfe2-19bc-4629-8025-1758c22affeb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047997 May 13 13:32:13.932396 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 439/901] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:14.182695 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-43f2de7d-03ca-461e-ae57-0ab4423dc80d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:14.183310 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-43f2de7d-03ca-461e-ae57-0ab4423dc80d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:14.189649 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-43f2de7d-03ca-461e-ae57-0ab4423dc80d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:14.190159 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-43f2de7d-03ca-461e-ae57-0ab4423dc80d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:14.190967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-43f2de7d-03ca-461e-ae57-0ab4423dc80d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:14.191412 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-43f2de7d-03ca-461e-ae57-0ab4423dc80d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:14.409743 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-43f2de7d-03ca-461e-ae57-0ab4423dc80d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:14.417128 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-43f2de7d-03ca-461e-ae57-0ab4423dc80d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1277 microversion: 2.1 time: 0.238275 May 13 13:32:14.418038 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 463/902] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:14 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:14.766616 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c9d59183-e067-408b-b897-0ea70a16942e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:14.767247 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c9d59183-e067-408b-b897-0ea70a16942e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:14.773370 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c9d59183-e067-408b-b897-0ea70a16942e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:14.777926 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c9d59183-e067-408b-b897-0ea70a16942e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:14.778752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c9d59183-e067-408b-b897-0ea70a16942e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:14.779212 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c9d59183-e067-408b-b897-0ea70a16942e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:14.794196 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-c9d59183-e067-408b-b897-0ea70a16942e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] HTTP exception thrown: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c9d59183-e067-408b-b897-0ea70a16942e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Request method failure captured: May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: DELETE /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f HTTP/1.1 May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflxDsrR31d-SIPD1D4egqJyf_jEs09f36p1mrqUfLT1xjmNSuYYzyE2vQ4C6DwTgEOSOnnkEC356p4RUfAO2l28KjPny4Rw_8RIFFB5LVj3w3gniM-a-g0rkXENFpzhgwelNJ4jja7MX52P9WxDDeZs9AjEoJQhEZAiivYDURiGU3YQ May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 915a7ff1f6d64480a08c38e762da4134 May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:32:14.795905 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:32:14.797510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_915a7ff1f6d64480a08c38e762da4134", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:32:14.797510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:14.797510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 915a7ff1f6d64480a08c38e762da4134 May 13 13:32:14.797510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:14.797510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeTestJSON-961764179-project May 13 13:32:14.797510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:32:14.797510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:32:14.797510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 233f5342cf334c7689cb9e71f4fbaab3 May 13 13:32:14.797510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeTestJSON-961764179-project May 13 13:32:14.797510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:32:14.797510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:32:14.797510 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f'} May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:14.798433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:32:14.800022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:14.801417 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c9d59183-e067-408b-b897-0ea70a16942e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Returning 404 to user: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:14.801417 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c9d59183-e067-408b-b897-0ea70a16942e tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "DELETE /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 404 len: 111 microversion: 2.1 time: 0.036205 May 13 13:32:14.801417 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 440/903] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:32:14 2022] DELETE /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:32:14.805715 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-63383c34-46c7-4b6e-b18d-790eb3bf46d6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:14.806426 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-63383c34-46c7-4b6e-b18d-790eb3bf46d6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] [instance: 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:14.812190 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-63383c34-46c7-4b6e-b18d-790eb3bf46d6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:14.812682 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-63383c34-46c7-4b6e-b18d-790eb3bf46d6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:14.813452 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-63383c34-46c7-4b6e-b18d-790eb3bf46d6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:14.813920 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-63383c34-46c7-4b6e-b18d-790eb3bf46d6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:14.827086 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-63383c34-46c7-4b6e-b18d-790eb3bf46d6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] HTTP exception thrown: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-63383c34-46c7-4b6e-b18d-790eb3bf46d6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Request method failure captured: May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f HTTP/1.1 May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflxDsrR31d-SIPD1D4egqJyf_jEs09f36p1mrqUfLT1xjmNSuYYzyE2vQ4C6DwTgEOSOnnkEC356p4RUfAO2l28KjPny4Rw_8RIFFB5LVj3w3gniM-a-g0rkXENFpzhgwelNJ4jja7MX52P9WxDDeZs9AjEoJQhEZAiivYDURiGU3YQ May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 915a7ff1f6d64480a08c38e762da4134 May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:32:14.829199 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:32:14.830908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_915a7ff1f6d64480a08c38e762da4134", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/915a7ff1f6d64480a08c38e762da4134"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:32:14.830908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:14.830908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 915a7ff1f6d64480a08c38e762da4134 May 13 13:32:14.830908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeTestJSON-961764179 May 13 13:32:14.830908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeTestJSON-961764179-project May 13 13:32:14.830908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:32:14.830908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:32:14.830908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 233f5342cf334c7689cb9e71f4fbaab3 May 13 13:32:14.830908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeTestJSON-961764179-project May 13 13:32:14.830908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:32:14.830908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:32:14.830908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f'} May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:14.836167 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. May 13 13:32:14.838228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:14.839603 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-63383c34-46c7-4b6e-b18d-790eb3bf46d6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] Returning 404 to user: Instance 58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:14.839603 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-63383c34-46c7-4b6e-b18d-790eb3bf46d6 tempest-AttachVolumeTestJSON-961764179 tempest-AttachVolumeTestJSON-961764179-project] 10.222.0.25 "GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f" status: 404 len: 111 microversion: 2.1 time: 0.028720 May 13 13:32:14.839603 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 464/904] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:14 2022] GET /compute/v2.1/servers/58bc1d54-c1ff-4eb9-91a4-f2282dc9f26f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:32:15.081285 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-970604653", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2146808143", "security_groups": [{"name": "tempest-secgroup-smoke-273691430"}], "networks": [{"uuid": "8a936522-2bfb-4af4-991c-21176e7e46d4"}], "block_device_mapping_v2": [{"uuid": "8d7d5791-6a89-4625-b9f5-27fa583bc7aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:15.245600 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.network.neutron [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] validate_networks() for [('8a936522-2bfb-4af4-991c-21176e7e46d4', None, None, None, None, None)] {{(pid=117602) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:32:15.435238 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-502476d9-86a4-46a4-9eb9-7694b59963fe tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:15.435841 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-502476d9-86a4-46a4-9eb9-7694b59963fe tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:15.444372 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-502476d9-86a4-46a4-9eb9-7694b59963fe tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:15.445083 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-502476d9-86a4-46a4-9eb9-7694b59963fe tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:15.445884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-502476d9-86a4-46a4-9eb9-7694b59963fe tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:15.446321 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-502476d9-86a4-46a4-9eb9-7694b59963fe tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:15.584494 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-502476d9-86a4-46a4-9eb9-7694b59963fe tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:15.592685 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-502476d9-86a4-46a4-9eb9-7694b59963fe tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1277 microversion: 2.1 time: 0.162780 May 13 13:32:15.593250 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 465/905] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:15 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:15.960416 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Flavor limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:32:15.960933 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Image limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:32:15.961319 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Flavor pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:32:15.961737 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Image pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:32:15.968832 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:32:15.971737 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:15.972185 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:15.973002 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:15.973448 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:15.990369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Getting quotas for project 0b1cc4c699be4edfa243bc7dde91cd51. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:32:15.994222 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Getting quotas for user 9c6a8bd3014349a3aa60c9471f3c8234 and project 0b1cc4c699be4edfa243bc7dde91cd51. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:32:16.058712 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Going to run 1 instances... {{(pid=117602) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:32:16.061096 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d7d5791-6a89-4625-b9f5-27fa583bc7aa',volume_size=None,volume_type=None)] {{(pid=117602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:32:16.524569 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a6f8d439-10d0-4ba3-8a36-c0873c9c17fd tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.447954 May 13 13:32:16.525502 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 441/906] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:32:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:32:16.535755 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c22946fa-a9e8-425a-b06e-d0b6090818f5 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:16.536410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c22946fa-a9e8-425a-b06e-d0b6090818f5 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:16.603028 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c22946fa-a9e8-425a-b06e-d0b6090818f5 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:16.608369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-efc3160b-ecac-47c4-a202-c744c073d74b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:16.608988 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-efc3160b-ecac-47c4-a202-c744c073d74b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:16.611046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c22946fa-a9e8-425a-b06e-d0b6090818f5 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1088 microversion: 2.1 time: 0.079424 May 13 13:32:16.611936 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 466/907] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:16 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:16.625591 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-efc3160b-ecac-47c4-a202-c744c073d74b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:16.626087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-efc3160b-ecac-47c4-a202-c744c073d74b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:16.626885 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-efc3160b-ecac-47c4-a202-c744c073d74b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:16.627323 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-efc3160b-ecac-47c4-a202-c744c073d74b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:16.835265 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-efc3160b-ecac-47c4-a202-c744c073d74b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:16.842834 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-efc3160b-ecac-47c4-a202-c744c073d74b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1277 microversion: 2.1 time: 0.238223 May 13 13:32:16.852582 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 442/908] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:16 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:17.627761 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-391947b8-b584-46c9-bcd2-465dc7c5a45f tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:17.628307 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-391947b8-b584-46c9-bcd2-465dc7c5a45f tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:17.860842 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6c0efd1c-fc45-43be-b261-56b48825a46e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:17.861454 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6c0efd1c-fc45-43be-b261-56b48825a46e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:17.869309 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6c0efd1c-fc45-43be-b261-56b48825a46e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:17.869935 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6c0efd1c-fc45-43be-b261-56b48825a46e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:17.871289 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6c0efd1c-fc45-43be-b261-56b48825a46e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:17.875632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6c0efd1c-fc45-43be-b261-56b48825a46e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:17.944222 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-391947b8-b584-46c9-bcd2-465dc7c5a45f tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:17.947165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-391947b8-b584-46c9-bcd2-465dc7c5a45f tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1088 microversion: 2.1 time: 0.323220 May 13 13:32:17.948272 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 467/909] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:17 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1088 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:18.061622 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6c0efd1c-fc45-43be-b261-56b48825a46e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:18.070862 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6c0efd1c-fc45-43be-b261-56b48825a46e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1277 microversion: 2.1 time: 0.214529 May 13 13:32:18.082142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 443/910] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:17 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1277 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:18.264789 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2a52ff20-13cd-4d95-a32f-f9676961021b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: .version_select at 0x7faaa1cde940>, body: {"keypair": {"name": "tempest-keypair-963685804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGa3N6WJUJ+0G2uQmHLac3MoaHaY+zf0nb32VjQcDlgmi60BP2b8z6xqet5O18NQemrs+hKqj0y8bK7VzDBhayE8Rt3Nlu2wB1ODu8m2UAmVfa2JOg95e2y1H3yYe/WBw=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:18.278873 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-2a52ff20-13cd-4d95-a32f-f9676961021b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for project 1e72f39546704606927bcefdc0f13235. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:32:18.286454 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-2a52ff20-13cd-4d95-a32f-f9676961021b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for user 79dbde2a65224927af4bb5e77090496c and project 1e72f39546704606927bcefdc0f13235. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:32:18.415357 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2a52ff20-13cd-4d95-a32f-f9676961021b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.154361 May 13 13:32:18.416286 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 468/911] 10.222.0.25 () {60 vars in 1158 bytes} [Fri May 13 13:32:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:19.018611 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-bffc966a-c0ad-49dc-8ff0-ee3675ddcf15 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:19.018611 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-bffc966a-c0ad-49dc-8ff0-ee3675ddcf15 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:19.018611 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bffc966a-c0ad-49dc-8ff0-ee3675ddcf15 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:19.018611 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bffc966a-c0ad-49dc-8ff0-ee3675ddcf15 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:19.020097 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bffc966a-c0ad-49dc-8ff0-ee3675ddcf15 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:19.020097 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bffc966a-c0ad-49dc-8ff0-ee3675ddcf15 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:19.046311 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bffc966a-c0ad-49dc-8ff0-ee3675ddcf15 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:19.056001 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-bffc966a-c0ad-49dc-8ff0-ee3675ddcf15 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1186 microversion: 2.1 time: 0.095364 May 13 13:32:19.056588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 444/912] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:18 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1186 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:19.087275 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b9cb2e34-3b3c-4780-bea7-af90621172fb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:19.087875 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b9cb2e34-3b3c-4780-bea7-af90621172fb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:19.094796 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9cb2e34-3b3c-4780-bea7-af90621172fb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:19.095279 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9cb2e34-3b3c-4780-bea7-af90621172fb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:19.096111 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9cb2e34-3b3c-4780-bea7-af90621172fb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:19.096609 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b9cb2e34-3b3c-4780-bea7-af90621172fb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:19.314587 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b9cb2e34-3b3c-4780-bea7-af90621172fb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:19.322204 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b9cb2e34-3b3c-4780-bea7-af90621172fb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1277 microversion: 2.1 time: 0.238899 May 13 13:32:19.322773 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 469/913] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:19 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:20.072996 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b3247949-0062-45c1-b0cf-e1d33c0f9b5a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:20.073751 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b3247949-0062-45c1-b0cf-e1d33c0f9b5a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:20.080597 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b3247949-0062-45c1-b0cf-e1d33c0f9b5a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:20.081185 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b3247949-0062-45c1-b0cf-e1d33c0f9b5a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:20.082305 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b3247949-0062-45c1-b0cf-e1d33c0f9b5a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:20.082820 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b3247949-0062-45c1-b0cf-e1d33c0f9b5a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:20.149395 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b3247949-0062-45c1-b0cf-e1d33c0f9b5a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:20.159955 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b3247949-0062-45c1-b0cf-e1d33c0f9b5a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1204 microversion: 2.1 time: 0.090776 May 13 13:32:20.160794 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 445/914] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:20 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:20.344116 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-970c19f3-fd17-4e19-8ce6-cc66a4931063 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:20.344116 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-970c19f3-fd17-4e19-8ce6-cc66a4931063 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:20.352781 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-970c19f3-fd17-4e19-8ce6-cc66a4931063 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:20.353395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-970c19f3-fd17-4e19-8ce6-cc66a4931063 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:20.354962 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-970c19f3-fd17-4e19-8ce6-cc66a4931063 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:20.355673 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-970c19f3-fd17-4e19-8ce6-cc66a4931063 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:20.697832 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-970c19f3-fd17-4e19-8ce6-cc66a4931063 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:20.706002 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-970c19f3-fd17-4e19-8ce6-cc66a4931063 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1265 microversion: 2.1 time: 0.370296 May 13 13:32:20.721469 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 470/915] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:20 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1265 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:21.180058 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0658c913-070a-43c1-a5d6-1af37c65eb72 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:21.181290 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0658c913-070a-43c1-a5d6-1af37c65eb72 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:21.188723 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0658c913-070a-43c1-a5d6-1af37c65eb72 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.189426 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0658c913-070a-43c1-a5d6-1af37c65eb72 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.190259 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0658c913-070a-43c1-a5d6-1af37c65eb72 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.190704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0658c913-070a-43c1-a5d6-1af37c65eb72 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.404413 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-0658c913-070a-43c1-a5d6-1af37c65eb72 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:21.412683 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0658c913-070a-43c1-a5d6-1af37c65eb72 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1271 microversion: 2.1 time: 0.236509 May 13 13:32:21.413280 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 446/916] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:21 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1271 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:21.725085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6e6a3703-f6ed-4ca3-a71f-146aa84c7cc8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:21.725755 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6e6a3703-f6ed-4ca3-a71f-146aa84c7cc8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:21.732386 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6e6a3703-f6ed-4ca3-a71f-146aa84c7cc8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.733052 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6e6a3703-f6ed-4ca3-a71f-146aa84c7cc8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.734234 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6e6a3703-f6ed-4ca3-a71f-146aa84c7cc8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.735380 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6e6a3703-f6ed-4ca3-a71f-146aa84c7cc8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.775254 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-b9cbc0d4-1e92-4850-8b09-998168e03fb4 req-143c0823-5d65-4e3f-bb77-3a024fc6d120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69", "tag": "419528c3-a163-4096-aa94-d0e53f8d5d30"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:21.793772 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-b9cbc0d4-1e92-4850-8b09-998168e03fb4 req-143c0823-5d65-4e3f-bb77-3a024fc6d120 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:21.796660 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-b9cbc0d4-1e92-4850-8b09-998168e03fb4 req-143c0823-5d65-4e3f-bb77-3a024fc6d120 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:21.807894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-b9cbc0d4-1e92-4850-8b09-998168e03fb4 req-143c0823-5d65-4e3f-bb77-3a024fc6d120 service nova] Creating event network-changed:419528c3-a163-4096-aa94-d0e53f8d5d30 for instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 on hv-cinder-84159 May 13 13:32:21.814115 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-b9cbc0d4-1e92-4850-8b09-998168e03fb4 req-143c0823-5d65-4e3f-bb77-3a024fc6d120 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046890 May 13 13:32:21.815417 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 447/917] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:22.079687 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6e6a3703-f6ed-4ca3-a71f-146aa84c7cc8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:22.089879 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6e6a3703-f6ed-4ca3-a71f-146aa84c7cc8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1265 microversion: 2.1 time: 0.369954 May 13 13:32:22.091170 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 471/918] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:21 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:22.260336 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1441003226", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46cd8800-6675-4b3d-a84e-b42f58021a8c"}], "security_groups": [{"name": "tempest-securitygroup--383254206"}], "key_name": "tempest-keypair-963685804", "user_data": "}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:22.366391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.network.neutron [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] validate_networks() for [('46cd8800-6675-4b3d-a84e-b42f58021a8c', None, None, None, None, None)] {{(pid=117602) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:32:22.430136 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7ef920d6-822f-4214-a142-1fc2573f2818 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:22.431072 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7ef920d6-822f-4214-a142-1fc2573f2818 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:22.455046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ef920d6-822f-4214-a142-1fc2573f2818 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:22.455503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ef920d6-822f-4214-a142-1fc2573f2818 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:22.456342 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ef920d6-822f-4214-a142-1fc2573f2818 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:22.456809 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7ef920d6-822f-4214-a142-1fc2573f2818 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:22.769894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Flavor limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:32:22.770333 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Image limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:32:22.770820 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Flavor pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:32:22.771240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Image pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:32:22.771660 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:32:22.781930 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:22.781930 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:22.782431 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:22.783076 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:22.800914 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for project 1e72f39546704606927bcefdc0f13235. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:32:22.806119 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for user 79dbde2a65224927af4bb5e77090496c and project 1e72f39546704606927bcefdc0f13235. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:32:22.818151 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Going to run 1 instances... {{(pid=117602) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:32:22.820677 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:32:22.847678 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-7ef920d6-822f-4214-a142-1fc2573f2818 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:22.860832 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7ef920d6-822f-4214-a142-1fc2573f2818 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1259 microversion: 2.1 time: 0.434373 May 13 13:32:22.868765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 472/919] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:22 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1259 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:22.924556 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-91e01dd9-9abe-4879-8632-d24d43b86ee4 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.669634 May 13 13:32:22.925216 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 448/920] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:32:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:32:22.935792 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-16680e20-81ce-48fb-964c-82a5f751966d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:22.936796 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-16680e20-81ce-48fb-964c-82a5f751966d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:23.021366 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-16680e20-81ce-48fb-964c-82a5f751966d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:23.029778 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-16680e20-81ce-48fb-964c-82a5f751966d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1241 microversion: 2.1 time: 0.098013 May 13 13:32:23.031410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 473/921] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:22 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:23.107077 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ad32cc9d-9563-480d-9c34-4f4178d03466 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:23.107698 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ad32cc9d-9563-480d-9c34-4f4178d03466 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:23.114821 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ad32cc9d-9563-480d-9c34-4f4178d03466 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.115286 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ad32cc9d-9563-480d-9c34-4f4178d03466 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:23.116131 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ad32cc9d-9563-480d-9c34-4f4178d03466 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.116579 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ad32cc9d-9563-480d-9c34-4f4178d03466 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:23.260590 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ad32cc9d-9563-480d-9c34-4f4178d03466 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:23.268070 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ad32cc9d-9563-480d-9c34-4f4178d03466 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1265 microversion: 2.1 time: 0.164858 May 13 13:32:23.268719 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 449/922] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:23 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:23.879924 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-56371f6d-957f-4e04-8eeb-c9d55b397af4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:23.880548 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-56371f6d-957f-4e04-8eeb-c9d55b397af4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:23.889370 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56371f6d-957f-4e04-8eeb-c9d55b397af4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.889870 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56371f6d-957f-4e04-8eeb-c9d55b397af4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:23.891206 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56371f6d-957f-4e04-8eeb-c9d55b397af4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:23.891651 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56371f6d-957f-4e04-8eeb-c9d55b397af4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.026238 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-56371f6d-957f-4e04-8eeb-c9d55b397af4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:24.033671 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-56371f6d-957f-4e04-8eeb-c9d55b397af4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1259 microversion: 2.1 time: 0.157558 May 13 13:32:24.034292 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 474/923] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:23 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:24.047501 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8c54cc64-e8d4-41e6-ba9a-31c9fc81bc69 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:24.048137 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8c54cc64-e8d4-41e6-ba9a-31c9fc81bc69 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:24.054108 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8c54cc64-e8d4-41e6-ba9a-31c9fc81bc69 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:24.054564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8c54cc64-e8d4-41e6-ba9a-31c9fc81bc69 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.055376 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8c54cc64-e8d4-41e6-ba9a-31c9fc81bc69 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:24.055814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8c54cc64-e8d4-41e6-ba9a-31c9fc81bc69 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.117145 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-8c54cc64-e8d4-41e6-ba9a-31c9fc81bc69 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:24.124464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8c54cc64-e8d4-41e6-ba9a-31c9fc81bc69 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1245 microversion: 2.1 time: 0.080944 May 13 13:32:24.131157 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 450/924] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:24 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:24.284566 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-15863641-7933-4800-9311-53f7de15828a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:24.285356 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-15863641-7933-4800-9311-53f7de15828a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:24.291192 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-15863641-7933-4800-9311-53f7de15828a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:24.291642 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-15863641-7933-4800-9311-53f7de15828a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.292411 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-15863641-7933-4800-9311-53f7de15828a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:24.292852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-15863641-7933-4800-9311-53f7de15828a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:24.427793 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-15863641-7933-4800-9311-53f7de15828a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:24.436156 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-15863641-7933-4800-9311-53f7de15828a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1265 microversion: 2.1 time: 0.155470 May 13 13:32:24.436721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 475/925] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:24 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:25.051282 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-bb6b96b3-a26c-43c9-8bff-32f4788291d2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:25.051882 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-bb6b96b3-a26c-43c9-8bff-32f4788291d2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:25.059496 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bb6b96b3-a26c-43c9-8bff-32f4788291d2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.060068 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bb6b96b3-a26c-43c9-8bff-32f4788291d2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.061397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bb6b96b3-a26c-43c9-8bff-32f4788291d2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.061919 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bb6b96b3-a26c-43c9-8bff-32f4788291d2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.141885 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-93869efb-74e5-4c79-b206-1b946417929c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:25.142503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-93869efb-74e5-4c79-b206-1b946417929c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:25.157835 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-93869efb-74e5-4c79-b206-1b946417929c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.158705 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-93869efb-74e5-4c79-b206-1b946417929c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.167165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-93869efb-74e5-4c79-b206-1b946417929c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.167864 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-93869efb-74e5-4c79-b206-1b946417929c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.219688 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bb6b96b3-a26c-43c9-8bff-32f4788291d2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:25.232851 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-bb6b96b3-a26c-43c9-8bff-32f4788291d2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1259 microversion: 2.1 time: 0.186306 May 13 13:32:25.233447 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 451/926] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:25 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:25.247974 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-93869efb-74e5-4c79-b206-1b946417929c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:25.256671 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-93869efb-74e5-4c79-b206-1b946417929c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1301 microversion: 2.1 time: 0.119365 May 13 13:32:25.257939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 476/927] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:25 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1301 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:25.452453 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a66b9459-a590-415e-b0ec-f9aa962f2515 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:25.453630 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a66b9459-a590-415e-b0ec-f9aa962f2515 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:25.460299 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a66b9459-a590-415e-b0ec-f9aa962f2515 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.461090 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a66b9459-a590-415e-b0ec-f9aa962f2515 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.461511 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a66b9459-a590-415e-b0ec-f9aa962f2515 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:25.461994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a66b9459-a590-415e-b0ec-f9aa962f2515 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:25.607785 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a66b9459-a590-415e-b0ec-f9aa962f2515 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:25.615795 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a66b9459-a590-415e-b0ec-f9aa962f2515 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1265 microversion: 2.1 time: 0.167273 May 13 13:32:25.616660 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 452/928] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:25 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:26.249958 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b5217a33-1a4b-4048-89fb-c208a8259dcf tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:26.250632 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b5217a33-1a4b-4048-89fb-c208a8259dcf tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:26.257149 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5217a33-1a4b-4048-89fb-c208a8259dcf tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:26.257606 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5217a33-1a4b-4048-89fb-c208a8259dcf tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.258424 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5217a33-1a4b-4048-89fb-c208a8259dcf tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:26.258875 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b5217a33-1a4b-4048-89fb-c208a8259dcf tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.282993 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5ad71094-42b5-4db3-9faa-167c2fb6851b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:26.283678 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-5ad71094-42b5-4db3-9faa-167c2fb6851b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:26.295426 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5ad71094-42b5-4db3-9faa-167c2fb6851b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:26.295879 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5ad71094-42b5-4db3-9faa-167c2fb6851b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.301578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5ad71094-42b5-4db3-9faa-167c2fb6851b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:26.302007 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5ad71094-42b5-4db3-9faa-167c2fb6851b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.443900 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-5ad71094-42b5-4db3-9faa-167c2fb6851b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:26.451308 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-5ad71094-42b5-4db3-9faa-167c2fb6851b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1366 microversion: 2.1 time: 0.178733 May 13 13:32:26.451877 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 453/929] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:26 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:26.503601 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b5217a33-1a4b-4048-89fb-c208a8259dcf tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:26.511029 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b5217a33-1a4b-4048-89fb-c208a8259dcf tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1259 microversion: 2.1 time: 0.264965 May 13 13:32:26.511623 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 477/930] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:26 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:26.633214 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-24d35448-b12e-44cf-9510-34ce0ab9559e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:26.633854 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-24d35448-b12e-44cf-9510-34ce0ab9559e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:26.639827 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-24d35448-b12e-44cf-9510-34ce0ab9559e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:26.640882 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-24d35448-b12e-44cf-9510-34ce0ab9559e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.641672 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-24d35448-b12e-44cf-9510-34ce0ab9559e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:26.642178 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-24d35448-b12e-44cf-9510-34ce0ab9559e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:26.794025 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-24d35448-b12e-44cf-9510-34ce0ab9559e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:26.804420 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-24d35448-b12e-44cf-9510-34ce0ab9559e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1265 microversion: 2.1 time: 0.175041 May 13 13:32:26.805069 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 454/931] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:26 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:26.995534 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-dd1d3222-0c64-4945-a786-951bc84cdf12 req-e57b4703-df8c-4fc5-b19f-3ff303d3a6ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75183d1d-a3aa-4781-8289-ff286fe85376", "tag": "f187807d-97c8-42df-9d28-a62462466845"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:27.007250 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-dd1d3222-0c64-4945-a786-951bc84cdf12 req-e57b4703-df8c-4fc5-b19f-3ff303d3a6ee service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:27.007250 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-dd1d3222-0c64-4945-a786-951bc84cdf12 req-e57b4703-df8c-4fc5-b19f-3ff303d3a6ee service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:27.020752 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-dd1d3222-0c64-4945-a786-951bc84cdf12 req-e57b4703-df8c-4fc5-b19f-3ff303d3a6ee service nova] Creating event network-changed:f187807d-97c8-42df-9d28-a62462466845 for instance 75183d1d-a3aa-4781-8289-ff286fe85376 on hv-cinder-84159 May 13 13:32:27.026362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-dd1d3222-0c64-4945-a786-951bc84cdf12 req-e57b4703-df8c-4fc5-b19f-3ff303d3a6ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034341 May 13 13:32:27.027251 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 478/932] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:27.470392 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-96736dc9-8d1e-48e0-833a-a4ca7ae04f52 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:27.471953 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-96736dc9-8d1e-48e0-833a-a4ca7ae04f52 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:27.481150 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-96736dc9-8d1e-48e0-833a-a4ca7ae04f52 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:27.482210 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-96736dc9-8d1e-48e0-833a-a4ca7ae04f52 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:27.483253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-96736dc9-8d1e-48e0-833a-a4ca7ae04f52 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:27.484714 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-96736dc9-8d1e-48e0-833a-a4ca7ae04f52 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:27.531450 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5e16bd2d-0c8d-48a5-9aba-e727d40d86ca tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:27.532170 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5e16bd2d-0c8d-48a5-9aba-e727d40d86ca tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:27.542844 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5e16bd2d-0c8d-48a5-9aba-e727d40d86ca tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:27.543223 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5e16bd2d-0c8d-48a5-9aba-e727d40d86ca tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:27.547038 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5e16bd2d-0c8d-48a5-9aba-e727d40d86ca tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:27.547501 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5e16bd2d-0c8d-48a5-9aba-e727d40d86ca tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:27.664185 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-96736dc9-8d1e-48e0-833a-a4ca7ae04f52 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:27.672084 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-96736dc9-8d1e-48e0-833a-a4ca7ae04f52 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1366 microversion: 2.1 time: 0.206571 May 13 13:32:27.672710 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 455/933] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:27 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:27.787015 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5e16bd2d-0c8d-48a5-9aba-e727d40d86ca tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:27.794614 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5e16bd2d-0c8d-48a5-9aba-e727d40d86ca tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1259 microversion: 2.1 time: 0.270953 May 13 13:32:27.795321 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 479/934] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:27 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1259 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:27.877821 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-58c4b782-a24c-4183-9826-56f20bcbe73b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:27.878460 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-58c4b782-a24c-4183-9826-56f20bcbe73b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:27.884350 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-58c4b782-a24c-4183-9826-56f20bcbe73b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:27.884811 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-58c4b782-a24c-4183-9826-56f20bcbe73b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:27.885596 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-58c4b782-a24c-4183-9826-56f20bcbe73b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:27.886076 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-58c4b782-a24c-4183-9826-56f20bcbe73b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:28.016864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-58c4b782-a24c-4183-9826-56f20bcbe73b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:28.024272 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-58c4b782-a24c-4183-9826-56f20bcbe73b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1265 microversion: 2.1 time: 0.150545 May 13 13:32:28.024846 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 456/935] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:27 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:28.689117 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0534a039-58a8-4185-a4db-24773b58e603 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:28.689675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0534a039-58a8-4185-a4db-24773b58e603 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:28.695647 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0534a039-58a8-4185-a4db-24773b58e603 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:28.696110 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0534a039-58a8-4185-a4db-24773b58e603 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:28.696882 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0534a039-58a8-4185-a4db-24773b58e603 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:28.697329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0534a039-58a8-4185-a4db-24773b58e603 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:28.812064 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-81981adb-6e1b-4b2a-af9c-c621ea7e661d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:28.820773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-81981adb-6e1b-4b2a-af9c-c621ea7e661d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:28.820773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-81981adb-6e1b-4b2a-af9c-c621ea7e661d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:28.820773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-81981adb-6e1b-4b2a-af9c-c621ea7e661d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:28.821077 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-81981adb-6e1b-4b2a-af9c-c621ea7e661d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:28.821496 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-81981adb-6e1b-4b2a-af9c-c621ea7e661d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:28.844837 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0534a039-58a8-4185-a4db-24773b58e603 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:28.852085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0534a039-58a8-4185-a4db-24773b58e603 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1366 microversion: 2.1 time: 0.167551 May 13 13:32:28.852669 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 480/936] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:28 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:28.960085 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-81981adb-6e1b-4b2a-af9c-c621ea7e661d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:28.967808 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-81981adb-6e1b-4b2a-af9c-c621ea7e661d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1259 microversion: 2.1 time: 0.159659 May 13 13:32:28.968391 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 457/937] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:28 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:29.041535 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-847e881f-8b24-4d9d-a7bd-4dfb3edbc94b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:29.042210 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-847e881f-8b24-4d9d-a7bd-4dfb3edbc94b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:29.048942 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-847e881f-8b24-4d9d-a7bd-4dfb3edbc94b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:29.049428 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-847e881f-8b24-4d9d-a7bd-4dfb3edbc94b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:29.050357 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-847e881f-8b24-4d9d-a7bd-4dfb3edbc94b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:29.050855 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-847e881f-8b24-4d9d-a7bd-4dfb3edbc94b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:29.193076 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-847e881f-8b24-4d9d-a7bd-4dfb3edbc94b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:29.208327 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-847e881f-8b24-4d9d-a7bd-4dfb3edbc94b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1265 microversion: 2.1 time: 0.170523 May 13 13:32:29.208833 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 481/938] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:29 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:29.710818 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-2563150d-69dc-4e62-a6d4-7afbafc9471e req-59c7ec1f-1458-430e-83cb-401a6c0867ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd189827-5e6a-43de-b4f7-e596ff7c1fe5", "name": "network-vif-plugged", "status": "completed", "tag": "4d81ea3d-1342-41f8-9505-45e355cea083"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:29.729833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-2563150d-69dc-4e62-a6d4-7afbafc9471e req-59c7ec1f-1458-430e-83cb-401a6c0867ff service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:29.730289 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-2563150d-69dc-4e62-a6d4-7afbafc9471e req-59c7ec1f-1458-430e-83cb-401a6c0867ff service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:29.748488 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-2563150d-69dc-4e62-a6d4-7afbafc9471e req-59c7ec1f-1458-430e-83cb-401a6c0867ff service nova] Creating event network-vif-plugged:4d81ea3d-1342-41f8-9505-45e355cea083 for instance fd189827-5e6a-43de-b4f7-e596ff7c1fe5 on hv-cinder-84159 May 13 13:32:29.754871 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-2563150d-69dc-4e62-a6d4-7afbafc9471e req-59c7ec1f-1458-430e-83cb-401a6c0867ff service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056119 May 13 13:32:29.755545 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 458/939] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:29.871890 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4a6e55a7-001f-4ea9-90ee-3f148a9d8062 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:29.872614 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4a6e55a7-001f-4ea9-90ee-3f148a9d8062 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:29.879707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a6e55a7-001f-4ea9-90ee-3f148a9d8062 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:29.880160 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a6e55a7-001f-4ea9-90ee-3f148a9d8062 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:29.880957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a6e55a7-001f-4ea9-90ee-3f148a9d8062 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:29.881397 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4a6e55a7-001f-4ea9-90ee-3f148a9d8062 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:29.985883 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-02ecb5d5-8352-4d73-9cf4-ff2abe85217d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:29.987289 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-02ecb5d5-8352-4d73-9cf4-ff2abe85217d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:30.000404 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-02ecb5d5-8352-4d73-9cf4-ff2abe85217d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:30.001244 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-02ecb5d5-8352-4d73-9cf4-ff2abe85217d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:30.002370 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-02ecb5d5-8352-4d73-9cf4-ff2abe85217d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:30.006000 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-02ecb5d5-8352-4d73-9cf4-ff2abe85217d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:30.118926 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4a6e55a7-001f-4ea9-90ee-3f148a9d8062 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:30.128903 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4a6e55a7-001f-4ea9-90ee-3f148a9d8062 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1366 microversion: 2.1 time: 0.263002 May 13 13:32:30.129493 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 482/940] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:29 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:30.200881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-02ecb5d5-8352-4d73-9cf4-ff2abe85217d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:30.208548 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-02ecb5d5-8352-4d73-9cf4-ff2abe85217d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1259 microversion: 2.1 time: 0.227592 May 13 13:32:30.209113 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 459/941] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:29 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:30.225020 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-69067c76-1a0c-4918-97cd-2eaf03f9257a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:30.225634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-69067c76-1a0c-4918-97cd-2eaf03f9257a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:30.231422 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-69067c76-1a0c-4918-97cd-2eaf03f9257a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:30.231878 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-69067c76-1a0c-4918-97cd-2eaf03f9257a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:30.232652 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-69067c76-1a0c-4918-97cd-2eaf03f9257a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:30.233095 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-69067c76-1a0c-4918-97cd-2eaf03f9257a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:30.366457 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-69067c76-1a0c-4918-97cd-2eaf03f9257a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:30.373851 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-69067c76-1a0c-4918-97cd-2eaf03f9257a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1265 microversion: 2.1 time: 0.152457 May 13 13:32:30.396506 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 483/942] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:30 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:31.147722 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1504efbf-baee-4285-9dcf-99e59972ef59 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:31.148344 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1504efbf-baee-4285-9dcf-99e59972ef59 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:31.154729 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1504efbf-baee-4285-9dcf-99e59972ef59 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:31.155245 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1504efbf-baee-4285-9dcf-99e59972ef59 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:31.156069 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1504efbf-baee-4285-9dcf-99e59972ef59 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:31.156396 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1504efbf-baee-4285-9dcf-99e59972ef59 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:31.224624 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ce6e147c-d63f-4a79-9c0f-ade826f9ddf0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:31.226118 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ce6e147c-d63f-4a79-9c0f-ade826f9ddf0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:31.235868 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce6e147c-d63f-4a79-9c0f-ade826f9ddf0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:31.236726 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce6e147c-d63f-4a79-9c0f-ade826f9ddf0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:31.237574 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce6e147c-d63f-4a79-9c0f-ade826f9ddf0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:31.238263 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ce6e147c-d63f-4a79-9c0f-ade826f9ddf0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:31.291708 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1504efbf-baee-4285-9dcf-99e59972ef59 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:31.299610 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1504efbf-baee-4285-9dcf-99e59972ef59 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1366 microversion: 2.1 time: 0.155672 May 13 13:32:31.300185 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 460/943] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:31 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:31.384380 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ce6e147c-d63f-4a79-9c0f-ade826f9ddf0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:31.400556 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ce6e147c-d63f-4a79-9c0f-ade826f9ddf0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1259 microversion: 2.1 time: 0.179804 May 13 13:32:31.411311 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 484/944] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:31 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:31.411463 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7e595c95-3563-48f6-a5aa-a898e43ff19e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:31.412332 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7e595c95-3563-48f6-a5aa-a898e43ff19e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:31.418158 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7e595c95-3563-48f6-a5aa-a898e43ff19e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:31.418612 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7e595c95-3563-48f6-a5aa-a898e43ff19e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:31.419400 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7e595c95-3563-48f6-a5aa-a898e43ff19e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:31.419818 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7e595c95-3563-48f6-a5aa-a898e43ff19e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:31.554475 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-7e595c95-3563-48f6-a5aa-a898e43ff19e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:31.562889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7e595c95-3563-48f6-a5aa-a898e43ff19e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1265 microversion: 2.1 time: 0.155692 May 13 13:32:31.563728 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 461/945] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:31 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:31.778473 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-829e9d21-d869-4dba-9f41-780b33b7bfbe req-2f45272f-1ef8-48af-87a7-f1781248d1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75183d1d-a3aa-4781-8289-ff286fe85376", "name": "network-vif-plugged", "status": "completed", "tag": "f187807d-97c8-42df-9d28-a62462466845"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:31.787225 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-829e9d21-d869-4dba-9f41-780b33b7bfbe req-2f45272f-1ef8-48af-87a7-f1781248d1f1 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:31.787675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-829e9d21-d869-4dba-9f41-780b33b7bfbe req-2f45272f-1ef8-48af-87a7-f1781248d1f1 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:31.804459 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-829e9d21-d869-4dba-9f41-780b33b7bfbe req-2f45272f-1ef8-48af-87a7-f1781248d1f1 service nova] Creating event network-vif-plugged:f187807d-97c8-42df-9d28-a62462466845 for instance 75183d1d-a3aa-4781-8289-ff286fe85376 on hv-cinder-84159 May 13 13:32:31.809566 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-829e9d21-d869-4dba-9f41-780b33b7bfbe req-2f45272f-1ef8-48af-87a7-f1781248d1f1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034991 May 13 13:32:31.810747 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 485/946] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:32:32.317052 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-75471b91-bd1e-4f1a-9079-29714c99e888 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:32.317838 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-75471b91-bd1e-4f1a-9079-29714c99e888 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:32.331613 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-75471b91-bd1e-4f1a-9079-29714c99e888 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:32.331613 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-75471b91-bd1e-4f1a-9079-29714c99e888 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:32.331613 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-75471b91-bd1e-4f1a-9079-29714c99e888 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:32.331613 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-75471b91-bd1e-4f1a-9079-29714c99e888 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:32.420513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-25b15689-cbb2-4b9d-9629-31aa1f0a4c35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:32.421223 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-25b15689-cbb2-4b9d-9629-31aa1f0a4c35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:32.427980 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25b15689-cbb2-4b9d-9629-31aa1f0a4c35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:32.428432 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25b15689-cbb2-4b9d-9629-31aa1f0a4c35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:32.429243 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25b15689-cbb2-4b9d-9629-31aa1f0a4c35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:32.429690 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-25b15689-cbb2-4b9d-9629-31aa1f0a4c35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:32.563122 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-25b15689-cbb2-4b9d-9629-31aa1f0a4c35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:32.567347 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-75471b91-bd1e-4f1a-9079-29714c99e888 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:32.570552 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-25b15689-cbb2-4b9d-9629-31aa1f0a4c35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1259 microversion: 2.1 time: 0.154186 May 13 13:32:32.571130 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 486/947] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:32 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:32.576932 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-75471b91-bd1e-4f1a-9079-29714c99e888 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1366 microversion: 2.1 time: 0.263792 May 13 13:32:32.577646 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 462/948] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:32 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:32.589368 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-08c184aa-b51d-4589-a981-e72ba79d5d0a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:32.589368 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-08c184aa-b51d-4589-a981-e72ba79d5d0a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:32.592224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-08c184aa-b51d-4589-a981-e72ba79d5d0a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:32.592684 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-08c184aa-b51d-4589-a981-e72ba79d5d0a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:32.593548 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-08c184aa-b51d-4589-a981-e72ba79d5d0a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:32.594027 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-08c184aa-b51d-4589-a981-e72ba79d5d0a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:32.723387 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-08c184aa-b51d-4589-a981-e72ba79d5d0a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:32.732117 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-08c184aa-b51d-4589-a981-e72ba79d5d0a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1453 microversion: 2.1 time: 0.150517 May 13 13:32:32.733135 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 487/949] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:32 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:32.750469 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-eff80125-34a7-43d6-b2f9-06aaf71cedc7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:32.751002 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-eff80125-34a7-43d6-b2f9-06aaf71cedc7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:32.757194 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eff80125-34a7-43d6-b2f9-06aaf71cedc7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:32.757710 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eff80125-34a7-43d6-b2f9-06aaf71cedc7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:32.758612 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eff80125-34a7-43d6-b2f9-06aaf71cedc7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:32.759052 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eff80125-34a7-43d6-b2f9-06aaf71cedc7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:32.889411 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-eff80125-34a7-43d6-b2f9-06aaf71cedc7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:32.897440 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-eff80125-34a7-43d6-b2f9-06aaf71cedc7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1453 microversion: 2.1 time: 0.152187 May 13 13:32:32.898041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 463/950] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:32 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:33.588918 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6429d564-b16c-492a-8b2e-243cc4d372fc tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:33.589731 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6429d564-b16c-492a-8b2e-243cc4d372fc tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:33.594633 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-31fc299a-b631-4679-ae41-b366ef421dad tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:33.595335 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-31fc299a-b631-4679-ae41-b366ef421dad tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:33.596906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6429d564-b16c-492a-8b2e-243cc4d372fc tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:33.597359 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6429d564-b16c-492a-8b2e-243cc4d372fc tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:33.598188 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6429d564-b16c-492a-8b2e-243cc4d372fc tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:33.598637 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6429d564-b16c-492a-8b2e-243cc4d372fc tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:33.605958 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-31fc299a-b631-4679-ae41-b366ef421dad tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:33.606640 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-31fc299a-b631-4679-ae41-b366ef421dad tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:33.611785 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-31fc299a-b631-4679-ae41-b366ef421dad tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:33.612466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-31fc299a-b631-4679-ae41-b366ef421dad tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:33.776253 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6429d564-b16c-492a-8b2e-243cc4d372fc tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:33.785127 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6429d564-b16c-492a-8b2e-243cc4d372fc tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1259 microversion: 2.1 time: 0.200155 May 13 13:32:33.786324 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 488/951] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:33 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:33.831431 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-5e37020f-da24-495e-a124-1a94c2931f15 req-a9d0584d-e07c-43ae-8c36-5d7359894bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69", "name": "network-vif-plugged", "status": "completed", "tag": "419528c3-a163-4096-aa94-d0e53f8d5d30"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:33.841046 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-5e37020f-da24-495e-a124-1a94c2931f15 req-a9d0584d-e07c-43ae-8c36-5d7359894bc7 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:33.841722 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-5e37020f-da24-495e-a124-1a94c2931f15 req-a9d0584d-e07c-43ae-8c36-5d7359894bc7 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:33.854451 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-5e37020f-da24-495e-a124-1a94c2931f15 req-a9d0584d-e07c-43ae-8c36-5d7359894bc7 service nova] Creating event network-vif-plugged:419528c3-a163-4096-aa94-d0e53f8d5d30 for instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 on hv-cinder-84159 May 13 13:32:33.860476 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-5e37020f-da24-495e-a124-1a94c2931f15 req-a9d0584d-e07c-43ae-8c36-5d7359894bc7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 May 13 13:32:33.861882 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 489/952] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:32:33.922670 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-31fc299a-b631-4679-ae41-b366ef421dad tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:33.929839 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-31fc299a-b631-4679-ae41-b366ef421dad tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1366 microversion: 2.1 time: 0.338974 May 13 13:32:33.930415 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 464/953] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:33 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:34.802356 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2dee00d8-39ea-4f57-90b7-4da65ec575eb tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:34.803101 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2dee00d8-39ea-4f57-90b7-4da65ec575eb tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:34.809111 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2dee00d8-39ea-4f57-90b7-4da65ec575eb tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:34.809571 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2dee00d8-39ea-4f57-90b7-4da65ec575eb tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:34.810382 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2dee00d8-39ea-4f57-90b7-4da65ec575eb tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:34.810828 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2dee00d8-39ea-4f57-90b7-4da65ec575eb tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:34.946791 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1e5fb66c-1d58-4742-8e0a-1b0d6add9d7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:34.950449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2dee00d8-39ea-4f57-90b7-4da65ec575eb tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:34.950737 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1e5fb66c-1d58-4742-8e0a-1b0d6add9d7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:34.956924 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1e5fb66c-1d58-4742-8e0a-1b0d6add9d7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:34.960699 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1e5fb66c-1d58-4742-8e0a-1b0d6add9d7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:34.961578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1e5fb66c-1d58-4742-8e0a-1b0d6add9d7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:34.962206 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1e5fb66c-1d58-4742-8e0a-1b0d6add9d7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:34.965917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2dee00d8-39ea-4f57-90b7-4da65ec575eb tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1259 microversion: 2.1 time: 0.168164 May 13 13:32:34.966650 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 490/954] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:34 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:35.107718 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-4c32383d-e0a9-46da-a132-a50535ec256c req-1363e626-cbd3-42b2-928c-fdcda9df2168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd189827-5e6a-43de-b4f7-e596ff7c1fe5", "tag": "4d81ea3d-1342-41f8-9505-45e355cea083"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:35.117332 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-4c32383d-e0a9-46da-a132-a50535ec256c req-1363e626-cbd3-42b2-928c-fdcda9df2168 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:35.123282 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-4c32383d-e0a9-46da-a132-a50535ec256c req-1363e626-cbd3-42b2-928c-fdcda9df2168 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:35.129915 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-4c32383d-e0a9-46da-a132-a50535ec256c req-1363e626-cbd3-42b2-928c-fdcda9df2168 service nova] Creating event network-changed:4d81ea3d-1342-41f8-9505-45e355cea083 for instance fd189827-5e6a-43de-b4f7-e596ff7c1fe5 on hv-cinder-84159 May 13 13:32:35.133578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1e5fb66c-1d58-4742-8e0a-1b0d6add9d7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:35.135257 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-4c32383d-e0a9-46da-a132-a50535ec256c req-1363e626-cbd3-42b2-928c-fdcda9df2168 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031249 May 13 13:32:35.135934 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 491/955] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:32:35.144238 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1e5fb66c-1d58-4742-8e0a-1b0d6add9d7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1556 microversion: 2.1 time: 0.201300 May 13 13:32:35.144812 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 465/956] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:34 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1556 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:32:35.160801 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a334dc29-4a1c-4fd2-a1fe-ce63db35e2d0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:35.161390 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a334dc29-4a1c-4fd2-a1fe-ce63db35e2d0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:35.167790 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a334dc29-4a1c-4fd2-a1fe-ce63db35e2d0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:35.168253 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a334dc29-4a1c-4fd2-a1fe-ce63db35e2d0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:35.169045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a334dc29-4a1c-4fd2-a1fe-ce63db35e2d0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:35.169491 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a334dc29-4a1c-4fd2-a1fe-ce63db35e2d0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:35.273896 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a334dc29-4a1c-4fd2-a1fe-ce63db35e2d0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117120 May 13 13:32:35.274583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 492/957] 10.222.0.25 () {58 vars in 1274 bytes} [Fri May 13 13:32:35 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:35.982064 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f00d19da-5f1e-4ca7-ad3f-f5eeea357b36 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:35.982729 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f00d19da-5f1e-4ca7-ad3f-f5eeea357b36 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:35.991586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f00d19da-5f1e-4ca7-ad3f-f5eeea357b36 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:35.992065 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f00d19da-5f1e-4ca7-ad3f-f5eeea357b36 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:35.993505 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f00d19da-5f1e-4ca7-ad3f-f5eeea357b36 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:35.993989 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f00d19da-5f1e-4ca7-ad3f-f5eeea357b36 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:36.141764 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f00d19da-5f1e-4ca7-ad3f-f5eeea357b36 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:36.151262 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f00d19da-5f1e-4ca7-ad3f-f5eeea357b36 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1259 microversion: 2.1 time: 0.172879 May 13 13:32:36.152886 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 466/958] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:35 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:36.346850 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a6d5438a-a1c1-456d-8b2b-ba0921b4b02b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:36.347891 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a6d5438a-a1c1-456d-8b2b-ba0921b4b02b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:36.354740 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a6d5438a-a1c1-456d-8b2b-ba0921b4b02b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:36.355202 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a6d5438a-a1c1-456d-8b2b-ba0921b4b02b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:36.356045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a6d5438a-a1c1-456d-8b2b-ba0921b4b02b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:36.356456 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a6d5438a-a1c1-456d-8b2b-ba0921b4b02b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:36.395821 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a6d5438a-a1c1-456d-8b2b-ba0921b4b02b tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054582 May 13 13:32:36.396435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 493/959] 10.222.0.25 () {60 vars in 1342 bytes} [Fri May 13 13:32:36 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:36.457422 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-eaf04010-d4c5-4981-a265-22c46594a4f2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:36.461829 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-eaf04010-d4c5-4981-a265-22c46594a4f2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:36.465313 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eaf04010-d4c5-4981-a265-22c46594a4f2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:36.466031 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eaf04010-d4c5-4981-a265-22c46594a4f2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:36.466885 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eaf04010-d4c5-4981-a265-22c46594a4f2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:36.467389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-eaf04010-d4c5-4981-a265-22c46594a4f2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:36.506067 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-eaf04010-d4c5-4981-a265-22c46594a4f2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Going to try to terminate instance {{(pid=117602) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:32:36.945467 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-eaf04010-d4c5-4981-a265-22c46594a4f2 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 204 len: 0 microversion: 2.20 time: 0.492616 May 13 13:32:36.946097 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 467/960] 10.222.0.25 () {60 vars in 1279 bytes} [Fri May 13 13:32:36 2022] DELETE /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 13:32:36.955609 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d258c207-454c-420c-bd30-4e21e48a7ac3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:36.955609 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-d258c207-454c-420c-bd30-4e21e48a7ac3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:36.961546 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d258c207-454c-420c-bd30-4e21e48a7ac3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:36.962309 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d258c207-454c-420c-bd30-4e21e48a7ac3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:36.963187 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d258c207-454c-420c-bd30-4e21e48a7ac3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:36.963639 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-d258c207-454c-420c-bd30-4e21e48a7ac3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:36.981598 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-6f44a5c0-4858-4677-8c13-156ef5659df7 req-b4e40211-3f4b-4000-884c-1a147db039fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75183d1d-a3aa-4781-8289-ff286fe85376", "tag": "f187807d-97c8-42df-9d28-a62462466845"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:36.990654 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-6f44a5c0-4858-4677-8c13-156ef5659df7 req-b4e40211-3f4b-4000-884c-1a147db039fb service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:36.991850 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-6f44a5c0-4858-4677-8c13-156ef5659df7 req-b4e40211-3f4b-4000-884c-1a147db039fb service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:37.006061 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-6f44a5c0-4858-4677-8c13-156ef5659df7 req-b4e40211-3f4b-4000-884c-1a147db039fb service nova] Creating event network-changed:f187807d-97c8-42df-9d28-a62462466845 for instance 75183d1d-a3aa-4781-8289-ff286fe85376 on hv-cinder-84159 May 13 13:32:37.012943 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-6f44a5c0-4858-4677-8c13-156ef5659df7 req-b4e40211-3f4b-4000-884c-1a147db039fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035311 May 13 13:32:37.013962 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 468/961] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:32:37.107829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d258c207-454c-420c-bd30-4e21e48a7ac3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:37.119597 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d258c207-454c-420c-bd30-4e21e48a7ac3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:37.121279 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-d258c207-454c-420c-bd30-4e21e48a7ac3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:37.122512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d258c207-454c-420c-bd30-4e21e48a7ac3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.172135 May 13 13:32:37.123093 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 494/962] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:32:36 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:32:37.169648 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c54adb03-6bfd-4aeb-a9d1-a8663747de49 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:37.170331 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c54adb03-6bfd-4aeb-a9d1-a8663747de49 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:37.177125 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c54adb03-6bfd-4aeb-a9d1-a8663747de49 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:37.177542 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c54adb03-6bfd-4aeb-a9d1-a8663747de49 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:37.178357 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c54adb03-6bfd-4aeb-a9d1-a8663747de49 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:37.178801 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c54adb03-6bfd-4aeb-a9d1-a8663747de49 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:37.328700 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-c54adb03-6bfd-4aeb-a9d1-a8663747de49 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:37.336667 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c54adb03-6bfd-4aeb-a9d1-a8663747de49 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1444 microversion: 2.1 time: 0.171336 May 13 13:32:37.337247 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 469/963] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:37 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1444 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:37.358084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-fdfbbf74-29e0-47aa-9b48-d9226a3057e4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:37.358737 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-fdfbbf74-29e0-47aa-9b48-d9226a3057e4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:37.365900 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fdfbbf74-29e0-47aa-9b48-d9226a3057e4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:37.366358 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fdfbbf74-29e0-47aa-9b48-d9226a3057e4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:37.367146 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fdfbbf74-29e0-47aa-9b48-d9226a3057e4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:37.367595 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-fdfbbf74-29e0-47aa-9b48-d9226a3057e4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:37.521146 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-fdfbbf74-29e0-47aa-9b48-d9226a3057e4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:37.530562 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-fdfbbf74-29e0-47aa-9b48-d9226a3057e4 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1444 microversion: 2.1 time: 0.176252 May 13 13:32:37.531790 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 495/964] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:32:37 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:32:38.144992 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-bcea3ce1-98a3-4c79-aa22-00b919dfaee3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:38.145623 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-bcea3ce1-98a3-4c79-aa22-00b919dfaee3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:38.153708 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bcea3ce1-98a3-4c79-aa22-00b919dfaee3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:38.154204 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bcea3ce1-98a3-4c79-aa22-00b919dfaee3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:38.159996 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bcea3ce1-98a3-4c79-aa22-00b919dfaee3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:38.162319 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bcea3ce1-98a3-4c79-aa22-00b919dfaee3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:38.395374 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bcea3ce1-98a3-4c79-aa22-00b919dfaee3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:38.406348 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bcea3ce1-98a3-4c79-aa22-00b919dfaee3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:38.408588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bcea3ce1-98a3-4c79-aa22-00b919dfaee3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:38.410105 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-bcea3ce1-98a3-4c79-aa22-00b919dfaee3 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.271138 May 13 13:32:38.411833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 470/965] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:32:38 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:32:39.435385 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-64da8cd3-91c1-4f5c-92fd-91361314a504 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:39.436201 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-64da8cd3-91c1-4f5c-92fd-91361314a504 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:39.449666 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64da8cd3-91c1-4f5c-92fd-91361314a504 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:39.457065 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64da8cd3-91c1-4f5c-92fd-91361314a504 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:39.457065 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64da8cd3-91c1-4f5c-92fd-91361314a504 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:39.457065 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-64da8cd3-91c1-4f5c-92fd-91361314a504 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:39.660334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-64da8cd3-91c1-4f5c-92fd-91361314a504 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:39.669523 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-64da8cd3-91c1-4f5c-92fd-91361314a504 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:39.672697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-64da8cd3-91c1-4f5c-92fd-91361314a504 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:39.674236 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-64da8cd3-91c1-4f5c-92fd-91361314a504 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1726 microversion: 2.20 time: 0.243247 May 13 13:32:39.675133 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 496/966] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:32:39 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1726 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:32:40.175972 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-c8eca2ca-3559-4f99-bb64-bc0fc6054edb req-4f52ca66-69d0-47cb-842a-944c08d7d133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3", "name": "network-vif-deleted", "tag": "ed34b0e2-4b0c-4721-9e85-8167943bb597"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:40.186755 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-c8eca2ca-3559-4f99-bb64-bc0fc6054edb req-4f52ca66-69d0-47cb-842a-944c08d7d133 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:40.187284 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-c8eca2ca-3559-4f99-bb64-bc0fc6054edb req-4f52ca66-69d0-47cb-842a-944c08d7d133 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:40.223300 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-c8eca2ca-3559-4f99-bb64-bc0fc6054edb req-4f52ca66-69d0-47cb-842a-944c08d7d133 service nova] Creating event network-vif-deleted:ed34b0e2-4b0c-4721-9e85-8167943bb597 for instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 on hv-cinder-84159 May 13 13:32:40.229389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-c8eca2ca-3559-4f99-bb64-bc0fc6054edb req-4f52ca66-69d0-47cb-842a-944c08d7d133 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057495 May 13 13:32:40.236426 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 471/967] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:32:40.695395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:40.703593 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:40.703916 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:40.704558 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:40.705527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:40.706252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:40.740639 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:40.741094 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:40.741736 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lazy-loading 'fault' on Instance uuid 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:32:40.816522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:40.836941 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:40.839586 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08b9fbf87cfa417fbea857ae602a140e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd4aa315c4340a1a649d8c51cea0da9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:32:40.840875 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9aaebef9-2680-4e93-9008-6003442a8947 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 200 len: 1372 microversion: 2.20 time: 0.151697 May 13 13:32:40.851661 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 497/968] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:32:40 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:32:41.923818 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b6340f62-f9c4-4428-bd52-9e3a79a61b05 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:41.923818 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b6340f62-f9c4-4428-bd52-9e3a79a61b05 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:41.923818 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b6340f62-f9c4-4428-bd52-9e3a79a61b05 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:41.923818 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b6340f62-f9c4-4428-bd52-9e3a79a61b05 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b6340f62-f9c4-4428-bd52-9e3a79a61b05 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b6340f62-f9c4-4428-bd52-9e3a79a61b05 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-b6340f62-f9c4-4428-bd52-9e3a79a61b05 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] HTTP exception thrown: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b6340f62-f9c4-4428-bd52-9e3a79a61b05 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Request method failure captured: May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 HTTP/1.1 May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:32:41.925049 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflxAvGRy2tiu2cI_ixQF5FzAx6YJEzimPATwu9Pyi8dPeXq5oZeJBQHTYTQSz8kAy6w2iKF_J6iq10ptUJ4DKvEqmpIpvBAIv5kkRlnyrkUsPbpnpOSvUcgKRMT9hCVeMhv3cZQKSU6q02Ot1ADkR78jtpFAea4YPf-5eK9d8U9gkZU May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 4cd4aa315c4340a1a649d8c51cea0da9 May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4cd4aa315c4340a1a649d8c51cea0da9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 4cd4aa315c4340a1a649d8c51cea0da9 May 13 13:32:41.926010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeShelveTestJSON-190877774-project May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 08b9fbf87cfa417fbea857ae602a140e May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeShelveTestJSON-190877774-project May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3'} May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:41.927093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:41.928586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:41.929940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:41.929940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:41.929940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:41.929940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b6340f62-f9c4-4428-bd52-9e3a79a61b05 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Returning 404 to user: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:41.929940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b6340f62-f9c4-4428-bd52-9e3a79a61b05 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 404 len: 111 microversion: 2.20 time: 0.043570 May 13 13:32:41.929940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 472/969] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:32:41 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:32:41.930369 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d0eaf2c0-302f-4515-9a08-09ef0dba2662 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '.version_select at 0x7faaa1c28550>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:42.118165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d0eaf2c0-302f-4515-9a08-09ef0dba2662 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090882881" status: 204 len: 0 microversion: 2.20 time: 0.213706 May 13 13:32:42.119110 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 498/970] 10.222.0.25 () {60 vars in 1261 bytes} [Fri May 13 13:32:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2090882881 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 13:32:42.264894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-4de636fc-08b8-4a85-8ced-adb617037cb1 req-6f3bccbf-a265-434f-85c4-e9e080d699fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69", "tag": "419528c3-a163-4096-aa94-d0e53f8d5d30"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:42.273709 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-4de636fc-08b8-4a85-8ced-adb617037cb1 req-6f3bccbf-a265-434f-85c4-e9e080d699fd service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:42.274191 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-4de636fc-08b8-4a85-8ced-adb617037cb1 req-6f3bccbf-a265-434f-85c4-e9e080d699fd service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:42.288853 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-4de636fc-08b8-4a85-8ced-adb617037cb1 req-6f3bccbf-a265-434f-85c4-e9e080d699fd service nova] Creating event network-changed:419528c3-a163-4096-aa94-d0e53f8d5d30 for instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 on hv-cinder-84159 May 13 13:32:42.294727 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-4de636fc-08b8-4a85-8ced-adb617037cb1 req-6f3bccbf-a265-434f-85c4-e9e080d699fd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034377 May 13 13:32:42.295525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 473/971] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:32:44.201749 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-faf47125-abcd-471d-a36a-c73218506c2c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:44.202282 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-faf47125-abcd-471d-a36a-c73218506c2c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:44.209894 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-faf47125-abcd-471d-a36a-c73218506c2c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:44.210342 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-faf47125-abcd-471d-a36a-c73218506c2c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:44.211112 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-faf47125-abcd-471d-a36a-c73218506c2c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:44.211542 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-faf47125-abcd-471d-a36a-c73218506c2c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:44.224974 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-faf47125-abcd-471d-a36a-c73218506c2c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] HTTP exception thrown: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-faf47125-abcd-471d-a36a-c73218506c2c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Request method failure captured: May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 HTTP/1.1 May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflxAvGRy2tiu2cI_ixQF5FzAx6YJEzimPATwu9Pyi8dPeXq5oZeJBQHTYTQSz8kAy6w2iKF_J6iq10ptUJ4DKvEqmpIpvBAIv5kkRlnyrkUsPbpnpOSvUcgKRMT9hCVeMhv3cZQKSU6q02Ot1ADkR78jtpFAea4YPf-5eK9d8U9gkZU May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 4cd4aa315c4340a1a649d8c51cea0da9 May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:32:44.226664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:32:44.229514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4cd4aa315c4340a1a649d8c51cea0da9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:32:44.229514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:44.229514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 4cd4aa315c4340a1a649d8c51cea0da9 May 13 13:32:44.229514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:44.229514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeShelveTestJSON-190877774-project May 13 13:32:44.229514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:32:44.229514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:32:44.229514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 08b9fbf87cfa417fbea857ae602a140e May 13 13:32:44.229514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-190877774-project May 13 13:32:44.229514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:32:44.229514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:44.229514 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3'} May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:44.230986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:44.233260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:44.242503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-faf47125-abcd-471d-a36a-c73218506c2c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Returning 404 to user: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:44.242503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-faf47125-abcd-471d-a36a-c73218506c2c tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 404 len: 111 microversion: 2.20 time: 0.030557 May 13 13:32:44.242503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 499/972] 10.222.0.25 () {60 vars in 1279 bytes} [Fri May 13 13:32:44 2022] DELETE /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:32:44.242763 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-89a8d71c-5335-4a7b-a2bb-d67d2cd8f756 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:44.242763 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-89a8d71c-5335-4a7b-a2bb-d67d2cd8f756 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:44.245180 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-89a8d71c-5335-4a7b-a2bb-d67d2cd8f756 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:44.245768 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-89a8d71c-5335-4a7b-a2bb-d67d2cd8f756 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:44.246603 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-89a8d71c-5335-4a7b-a2bb-d67d2cd8f756 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:44.247041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-89a8d71c-5335-4a7b-a2bb-d67d2cd8f756 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:44.260708 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-89a8d71c-5335-4a7b-a2bb-d67d2cd8f756 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] HTTP exception thrown: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-89a8d71c-5335-4a7b-a2bb-d67d2cd8f756 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Request method failure captured: May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 HTTP/1.1 May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflxAvGRy2tiu2cI_ixQF5FzAx6YJEzimPATwu9Pyi8dPeXq5oZeJBQHTYTQSz8kAy6w2iKF_J6iq10ptUJ4DKvEqmpIpvBAIv5kkRlnyrkUsPbpnpOSvUcgKRMT9hCVeMhv3cZQKSU6q02Ot1ADkR78jtpFAea4YPf-5eK9d8U9gkZU May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 4cd4aa315c4340a1a649d8c51cea0da9 May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:32:44.262356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:32:44.264029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4cd4aa315c4340a1a649d8c51cea0da9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:32:44.264029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:44.264029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 4cd4aa315c4340a1a649d8c51cea0da9 May 13 13:32:44.264029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:44.264029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeShelveTestJSON-190877774-project May 13 13:32:44.264029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:32:44.264029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:32:44.264029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 08b9fbf87cfa417fbea857ae602a140e May 13 13:32:44.264029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeShelveTestJSON-190877774-project May 13 13:32:44.264029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:32:44.264029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:44.264029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3'} May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:44.264936 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. May 13 13:32:44.267041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:44.268540 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-89a8d71c-5335-4a7b-a2bb-d67d2cd8f756 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Returning 404 to user: Instance 3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:44.268540 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-89a8d71c-5335-4a7b-a2bb-d67d2cd8f756 tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3" status: 404 len: 111 microversion: 2.20 time: 0.030713 May 13 13:32:44.268540 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 474/973] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:32:44 2022] GET /compute/v2.1/servers/3ed3acdf-ad9a-49b9-82b6-fc4742cfaac3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 13 13:32:45.556926 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-84d44aa9-50a7-481b-b631-778301dc47bd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:45.557509 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-84d44aa9-50a7-481b-b631-778301dc47bd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:45.564431 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-84d44aa9-50a7-481b-b631-778301dc47bd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:45.564882 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-84d44aa9-50a7-481b-b631-778301dc47bd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:45.565711 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-84d44aa9-50a7-481b-b631-778301dc47bd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:45.566346 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-84d44aa9-50a7-481b-b631-778301dc47bd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:45.580313 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-84d44aa9-50a7-481b-b631-778301dc47bd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] HTTP exception thrown: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-84d44aa9-50a7-481b-b631-778301dc47bd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Request method failure captured: May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c HTTP/1.1 May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABiflxAvGRy2tiu2cI_ixQF5FzAx6YJEzimPATwu9Pyi8dPeXq5oZeJBQHTYTQSz8kAy6w2iKF_J6iq10ptUJ4DKvEqmpIpvBAIv5kkRlnyrkUsPbpnpOSvUcgKRMT9hCVeMhv3cZQKSU6q02Ot1ADkR78jtpFAea4YPf-5eK9d8U9gkZU May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 4cd4aa315c4340a1a649d8c51cea0da9 May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:32:45.581939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:32:45.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4cd4aa315c4340a1a649d8c51cea0da9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:32:45.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:45.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 4cd4aa315c4340a1a649d8c51cea0da9 May 13 13:32:45.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:45.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeShelveTestJSON-190877774-project May 13 13:32:45.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:32:45.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:32:45.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 08b9fbf87cfa417fbea857ae602a140e May 13 13:32:45.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeShelveTestJSON-190877774-project May 13 13:32:45.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:32:45.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:32:45.583944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '89412841-b653-4a80-8cde-0c7a264a9c4c'} May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:45.584745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:32:45.586047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:32:45.587283 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-84d44aa9-50a7-481b-b631-778301dc47bd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Returning 404 to user: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:45.587283 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-84d44aa9-50a7-481b-b631-778301dc47bd tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "DELETE /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 404 len: 111 microversion: 2.20 time: 0.031111 May 13 13:32:45.587283 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 500/974] 10.222.0.25 () {60 vars in 1279 bytes} [Fri May 13 13:32:45 2022] DELETE /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 13 13:32:45.593310 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-abc3f995-a5d3-4e43-a0d9-f4cd8af0ed0e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:45.594594 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-abc3f995-a5d3-4e43-a0d9-f4cd8af0ed0e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] [instance: 89412841-b653-4a80-8cde-0c7a264a9c4c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:32:45.600598 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-abc3f995-a5d3-4e43-a0d9-f4cd8af0ed0e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:45.601057 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-abc3f995-a5d3-4e43-a0d9-f4cd8af0ed0e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:45.601866 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-abc3f995-a5d3-4e43-a0d9-f4cd8af0ed0e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:32:45.602312 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-abc3f995-a5d3-4e43-a0d9-f4cd8af0ed0e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:32:45.617308 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-abc3f995-a5d3-4e43-a0d9-f4cd8af0ed0e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] HTTP exception thrown: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-abc3f995-a5d3-4e43-a0d9-f4cd8af0ed0e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Request method failure captured: May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c HTTP/1.1 May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABiflxAvGRy2tiu2cI_ixQF5FzAx6YJEzimPATwu9Pyi8dPeXq5oZeJBQHTYTQSz8kAy6w2iKF_J6iq10ptUJ4DKvEqmpIpvBAIv5kkRlnyrkUsPbpnpOSvUcgKRMT9hCVeMhv3cZQKSU6q02Ot1ADkR78jtpFAea4YPf-5eK9d8U9gkZU May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Openstack-Nova-Api-Version: 2.20 May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 4cd4aa315c4340a1a649d8c51cea0da9 May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:32:45.618897 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:32:45.620563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_4cd4aa315c4340a1a649d8c51cea0da9", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/4cd4aa315c4340a1a649d8c51cea0da9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:32:45.620563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:45.620563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 4cd4aa315c4340a1a649d8c51cea0da9 May 13 13:32:45.620563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-190877774 May 13 13:32:45.620563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeShelveTestJSON-190877774-project May 13 13:32:45.620563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:32:45.620563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:32:45.620563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 08b9fbf87cfa417fbea857ae602a140e May 13 13:32:45.620563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeShelveTestJSON-190877774-project May 13 13:32:45.620563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:32:45.620563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:32:45.620563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '89412841-b653-4a80-8cde-0c7a264a9c4c'} May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:45.621390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. May 13 13:32:45.622973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:45.624239 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-abc3f995-a5d3-4e43-a0d9-f4cd8af0ed0e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] Returning 404 to user: Instance 89412841-b653-4a80-8cde-0c7a264a9c4c could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:45.624239 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-abc3f995-a5d3-4e43-a0d9-f4cd8af0ed0e tempest-AttachVolumeShelveTestJSON-190877774 tempest-AttachVolumeShelveTestJSON-190877774-project] 10.222.0.25 "GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c" status: 404 len: 111 microversion: 2.20 time: 0.031179 May 13 13:32:45.624239 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 475/975] 10.222.0.25 () {60 vars in 1276 bytes} [Fri May 13 13:32:45 2022] GET /compute/v2.1/servers/89412841-b653-4a80-8cde-0c7a264a9c4c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 13:32:51.819683 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3705b535-5417-45b1-8375-b3c43bd1e1f0 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Action: 'create', calling method: .version_select at 0x7faaa1cbc1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-234408456"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:52.512957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3705b535-5417-45b1-8375-b3c43bd1e1f0 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.806945 May 13 13:32:52.513591 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 501/976] 10.222.0.25 () {60 vars in 1154 bytes} [Fri May 13 13:32:51 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 808 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 13 13:32:52.528314 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d0287b70-6f27-4cc7-81ba-0474584d1861 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1e77550>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:52.578655 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d0287b70-6f27-4cc7-81ba-0474584d1861 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6" status: 200 len: 344 microversion: 2.1 time: 0.054269 May 13 13:32:52.579095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 476/977] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:32:52 2022] GET /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:53.591749 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b4fa5cd0-4d1f-4057-b138-40f7a0c1fd05 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1c28c10>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:53.639441 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b4fa5cd0-4d1f-4057-b138-40f7a0c1fd05 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6" status: 200 len: 345 microversion: 2.1 time: 0.052242 May 13 13:32:53.641149 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 502/978] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:32:53 2022] GET /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:53.651708 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-caac39b5-48aa-4b1f-92ad-a986a3d2ce91 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Action: 'create', calling method: .version_select at 0x7faaa1bd1820>, body: {"snapshot": {"volume_id": "bd7800f3-4556-4591-b404-6b254abe13a6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-97715692"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:32:54.083283 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-caac39b5-48aa-4b1f-92ad-a986a3d2ce91 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.435747 May 13 13:32:54.091390 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 477/979] 10.222.0.25 () {60 vars in 1161 bytes} [Fri May 13 13:32:53 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:54.094144 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-22735ab7-80ec-4aeb-bf92-e6c0d48f8829 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1ebc670>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:54.123362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-22735ab7-80ec-4aeb-bf92-e6c0d48f8829 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1" status: 200 len: 285 microversion: 2.1 time: 0.033601 May 13 13:32:54.123930 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 503/980] 10.222.0.25 () {58 vars in 1250 bytes} [Fri May 13 13:32:54 2022] GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:54.134460 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2677cd9b-95a4-42f8-aa82-6c5d5a9e2ff1 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1d813a0>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:54.163849 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2677cd9b-95a4-42f8-aa82-6c5d5a9e2ff1 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.033114 May 13 13:32:54.165612 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 478/981] 10.222.0.25 () {58 vars in 1139 bytes} [Fri May 13 13:32:54 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:54.175592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ac9f7f10-a423-466e-893d-b2dac58d16f9 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1c78430>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:54.203721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ac9f7f10-a423-466e-893d-b2dac58d16f9 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1" status: 200 len: 285 microversion: 2.1 time: 0.032746 May 13 13:32:54.204356 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 504/982] 10.222.0.25 () {58 vars in 1250 bytes} [Fri May 13 13:32:54 2022] GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:32:55.216372 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c757213b-5bd8-413b-a1df-d9d531e7ff92 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1bd1940>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:55.245517 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c757213b-5bd8-413b-a1df-d9d531e7ff92 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1" status: 200 len: 285 microversion: 2.1 time: 0.033458 May 13 13:32:55.246145 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 479/983] 10.222.0.25 () {58 vars in 1250 bytes} [Fri May 13 13:32:55 2022] GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:56.258251 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b08a3feb-d177-4f0d-a015-9da99abb811e tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1c74820>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:56.286760 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b08a3feb-d177-4f0d-a015-9da99abb811e tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1" status: 200 len: 285 microversion: 2.1 time: 0.032777 May 13 13:32:56.287329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 505/984] 10.222.0.25 () {58 vars in 1250 bytes} [Fri May 13 13:32:56 2022] GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:57.298883 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-612ae01e-e12a-40ca-a857-cd90a32e13fe tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1dea8b0>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:57.330935 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-612ae01e-e12a-40ca-a857-cd90a32e13fe tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1" status: 200 len: 285 microversion: 2.1 time: 0.035713 May 13 13:32:57.331503 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 480/985] 10.222.0.25 () {58 vars in 1250 bytes} [Fri May 13 13:32:57 2022] GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:58.344279 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-39ad831e-78e4-4069-b773-423a11287352 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1cf3280>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:58.373323 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-39ad831e-78e4-4069-b773-423a11287352 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1" status: 200 len: 286 microversion: 2.1 time: 0.034146 May 13 13:32:58.373945 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 506/986] 10.222.0.25 () {58 vars in 1250 bytes} [Fri May 13 13:32:58 2022] GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:58.384826 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-70c19243-ce71-41c6-87d8-65443f9fc67a tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1e47310>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:58.482260 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-70c19243-ce71-41c6-87d8-65443f9fc67a tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1" status: 202 len: 0 microversion: 2.1 time: 0.101912 May 13 13:32:58.482835 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 481/987] 10.222.0.25 () {58 vars in 1253 bytes} [Fri May 13 13:32:58 2022] DELETE /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:32:58.491249 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8c11b8ed-a93c-4b72-b907-e02337d53e80 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1ebc940>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:58.521104 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8c11b8ed-a93c-4b72-b907-e02337d53e80 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1" status: 200 len: 285 microversion: 2.1 time: 0.033567 May 13 13:32:58.521678 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 507/988] 10.222.0.25 () {58 vars in 1250 bytes} [Fri May 13 13:32:58 2022] GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:32:59.534401 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-80fda1b3-d5aa-44a7-b6ce-56a6dcaaefc3 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1d20160>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:59.559270 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-80fda1b3-d5aa-44a7-b6ce-56a6dcaaefc3 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] HTTP exception thrown: Snapshot 808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 could not be found. May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-80fda1b3-d5aa-44a7-b6ce-56a6dcaaefc3 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Request method failure captured: May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 HTTP/1.1 May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl4Djo0isrVtGbjfK2qgc5TWtb9fhHSAl59m17JPs8jwBkjTPQLETmmXKraox_IgV9QpUqXTCVJYbw8lkB3qZY_iCaQaE5WzOlDpo95G7WBP3WvV20aYb3rb6Ys65ZmJjYOSxdCMlytSx0Hga5QomIeIb8qvURtCXbboCkt0OOVE3h4 May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: ec6436a7141248d58e05e8f156cfda29 May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-429448011 May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:32:59.568588 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec6436a7141248d58e05e8f156cfda29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec6436a7141248d58e05e8f156cfda29", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec6436a7141248d58e05e8f156cfda29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec6436a7141248d58e05e8f156cfda29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-VolumesSnapshotsTestJSON-429448011 May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: ec6436a7141248d58e05e8f156cfda29 May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-429448011 May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-VolumesSnapshotsTestJSON-429448011-project May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 50c3ffe59ef44c11a3cf19648b81287c May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-VolumesSnapshotsTestJSON-429448011-project May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Snapshot 808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 could not be found. May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '808d6dfc-d094-4ec7-9c87-22a0eab5f2a1'} May 13 13:32:59.574894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 could not be found. (HTTP 404) (Request-ID: req-ea61e043-0486-474c-8d05-f24d79fc5dae) May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:59.575967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:32:59.577169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 could not be found. May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 13 13:32:59.578402 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 could not be found. May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 could not be found. May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-80fda1b3-d5aa-44a7-b6ce-56a6dcaaefc3 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Returning 404 to user: Snapshot 808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-80fda1b3-d5aa-44a7-b6ce-56a6dcaaefc3 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1" status: 404 len: 111 microversion: 2.1 time: 0.041510 May 13 13:32:59.579697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 482/989] 10.222.0.25 () {58 vars in 1250 bytes} [Fri May 13 13:32:59 2022] GET /compute/v2.1/os-snapshots/808d6dfc-d094-4ec7-9c87-22a0eab5f2a1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:32:59.580632 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-902837ce-ae70-441a-9676-9eb232cd7c97 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1c28ca0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:59.755986 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-902837ce-ae70-441a-9676-9eb232cd7c97 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6" status: 202 len: 0 microversion: 2.1 time: 0.180749 May 13 13:32:59.756971 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 508/990] 10.222.0.25 () {58 vars in 1247 bytes} [Fri May 13 13:32:59 2022] DELETE /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:32:59.765446 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e75a8624-cfdd-4f87-9a1d-9a20403af0ef tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1d20790>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:32:59.812878 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e75a8624-cfdd-4f87-9a1d-9a20403af0ef tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6" status: 200 len: 344 microversion: 2.1 time: 0.050542 May 13 13:32:59.813452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 483/991] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:32:59 2022] GET /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:00.826114 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-03a96ddd-bb3f-4bea-a025-6f6e1362a589 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1cf3d30>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:00.853359 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-03a96ddd-bb3f-4bea-a025-6f6e1362a589 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] HTTP exception thrown: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-03a96ddd-bb3f-4bea-a025-6f6e1362a589 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Request method failure captured: May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6 HTTP/1.1 May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABifl4Djo0isrVtGbjfK2qgc5TWtb9fhHSAl59m17JPs8jwBkjTPQLETmmXKraox_IgV9QpUqXTCVJYbw8lkB3qZY_iCaQaE5WzOlDpo95G7WBP3WvV20aYb3rb6Ys65ZmJjYOSxdCMlytSx0Hga5QomIeIb8qvURtCXbboCkt0OOVE3h4 May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: ec6436a7141248d58e05e8f156cfda29 May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-429448011 May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:33:00.855410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec6436a7141248d58e05e8f156cfda29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec6436a7141248d58e05e8f156cfda29", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec6436a7141248d58e05e8f156cfda29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec6436a7141248d58e05e8f156cfda29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesSnapshotsTestJSON-429448011 May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: ec6436a7141248d58e05e8f156cfda29 May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-429448011 May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesSnapshotsTestJSON-429448011-project May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 50c3ffe59ef44c11a3cf19648b81287c May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesSnapshotsTestJSON-429448011-project May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'bd7800f3-4556-4591-b404-6b254abe13a6'} May 13 13:33:00.857008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. (HTTP 404) (Request-ID: req-3b4513e1-db62-44a6-b77c-f33a7b82dd73) May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:00.858178 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:33:00.859583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 13:33:00.860972 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-03a96ddd-bb3f-4bea-a025-6f6e1362a589 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Returning 404 to user: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-03a96ddd-bb3f-4bea-a025-6f6e1362a589 tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6" status: 404 len: 109 microversion: 2.1 time: 0.035124 May 13 13:33:00.862399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 509/992] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:33:00 2022] GET /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:33:00.870833 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4784c3d1-3fcc-421c-aba8-32b69839fcfc tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1e77430>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:00.897008 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-4784c3d1-3fcc-421c-aba8-32b69839fcfc tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] HTTP exception thrown: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4784c3d1-3fcc-421c-aba8-32b69839fcfc tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Request method failure captured: May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: DELETE /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6 HTTP/1.1 May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl4Djo0isrVtGbjfK2qgc5TWtb9fhHSAl59m17JPs8jwBkjTPQLETmmXKraox_IgV9QpUqXTCVJYbw8lkB3qZY_iCaQaE5WzOlDpo95G7WBP3WvV20aYb3rb6Ys65ZmJjYOSxdCMlytSx0Hga5QomIeIb8qvURtCXbboCkt0OOVE3h4 May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: ec6436a7141248d58e05e8f156cfda29 May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-429448011 May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:33:00.898970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec6436a7141248d58e05e8f156cfda29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec6436a7141248d58e05e8f156cfda29", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec6436a7141248d58e05e8f156cfda29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec6436a7141248d58e05e8f156cfda29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-VolumesSnapshotsTestJSON-429448011 May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: ec6436a7141248d58e05e8f156cfda29 May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-429448011 May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-VolumesSnapshotsTestJSON-429448011-project May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 50c3ffe59ef44c11a3cf19648b81287c May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-VolumesSnapshotsTestJSON-429448011-project May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': 'bd7800f3-4556-4591-b404-6b254abe13a6'} May 13 13:33:00.900690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. (HTTP 404) (Request-ID: req-0d2f7f8a-3a6f-488a-b52a-c2f8e05c81e8) May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:00.901690 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:33:00.903198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 13:33:00.904891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4784c3d1-3fcc-421c-aba8-32b69839fcfc tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Returning 404 to user: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4784c3d1-3fcc-421c-aba8-32b69839fcfc tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6" status: 404 len: 109 microversion: 2.1 time: 0.033720 May 13 13:33:00.907253 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 484/993] 10.222.0.25 () {58 vars in 1247 bytes} [Fri May 13 13:33:00 2022] DELETE /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:33:00.909444 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cf2da7e9-d682-4e79-9d60-234e581cd5ab tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Calling method '.version_select at 0x7faaa1c2c8b0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:00.935597 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-cf2da7e9-d682-4e79-9d60-234e581cd5ab tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] HTTP exception thrown: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cf2da7e9-d682-4e79-9d60-234e581cd5ab tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Request method failure captured: May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6 HTTP/1.1 May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABifl4Djo0isrVtGbjfK2qgc5TWtb9fhHSAl59m17JPs8jwBkjTPQLETmmXKraox_IgV9QpUqXTCVJYbw8lkB3qZY_iCaQaE5WzOlDpo95G7WBP3WvV20aYb3rb6Ys65ZmJjYOSxdCMlytSx0Hga5QomIeIb8qvURtCXbboCkt0OOVE3h4 May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: ec6436a7141248d58e05e8f156cfda29 May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-429448011 May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:33:00.937512 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec6436a7141248d58e05e8f156cfda29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_ec6436a7141248d58e05e8f156cfda29", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/ec6436a7141248d58e05e8f156cfda29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/ec6436a7141248d58e05e8f156cfda29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-VolumesSnapshotsTestJSON-429448011 May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: ec6436a7141248d58e05e8f156cfda29 May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-429448011 May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-VolumesSnapshotsTestJSON-429448011-project May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 50c3ffe59ef44c11a3cf19648b81287c May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-VolumesSnapshotsTestJSON-429448011-project May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'bd7800f3-4556-4591-b404-6b254abe13a6'} May 13 13:33:00.939085 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. (HTTP 404) (Request-ID: req-8561c2a0-77a2-4c39-9bb1-305b7e5df20d) May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:00.939913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:33:00.941077 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 13:33:00.942252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-cf2da7e9-d682-4e79-9d60-234e581cd5ab tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] Returning 404 to user: Volume bd7800f3-4556-4591-b404-6b254abe13a6 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-cf2da7e9-d682-4e79-9d60-234e581cd5ab tempest-VolumesSnapshotsTestJSON-429448011 tempest-VolumesSnapshotsTestJSON-429448011-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6" status: 404 len: 109 microversion: 2.1 time: 0.033874 May 13 13:33:00.943445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 510/994] 10.222.0.25 () {58 vars in 1244 bytes} [Fri May 13 13:33:00 2022] GET /compute/v2.1/os-volumes/bd7800f3-4556-4591-b404-6b254abe13a6 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:33:20.736327 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e2b40d50-519f-4dae-bc88-1419ae700606 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:20.738186 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e2b40d50-519f-4dae-bc88-1419ae700606 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:20.744941 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e2b40d50-519f-4dae-bc88-1419ae700606 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:20.748455 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e2b40d50-519f-4dae-bc88-1419ae700606 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:20.748455 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e2b40d50-519f-4dae-bc88-1419ae700606 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:20.748455 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e2b40d50-519f-4dae-bc88-1419ae700606 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:20.770374 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e2b40d50-519f-4dae-bc88-1419ae700606 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376/ips" status: 200 len: 149 microversion: 2.1 time: 0.038272 May 13 13:33:20.771461 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 485/995] 10.222.0.25 () {58 vars in 1247 bytes} [Fri May 13 13:33:20 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:20.782024 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-994d5198-0e29-4351-bb41-a646bc9e54a1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f457fc60-31de-4afa-ae99-1f2af8b8275d"}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:33:20.783609 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-994d5198-0e29-4351-bb41-a646bc9e54a1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:20.795783 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-994d5198-0e29-4351-bb41-a646bc9e54a1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:20.795783 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-994d5198-0e29-4351-bb41-a646bc9e54a1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:20.795783 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-994d5198-0e29-4351-bb41-a646bc9e54a1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:20.795783 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-994d5198-0e29-4351-bb41-a646bc9e54a1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:20.871691 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-994d5198-0e29-4351-bb41-a646bc9e54a1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Invalid volume: volume f457fc60-31de-4afa-ae99-1f2af8b8275d is already attached to instances: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-994d5198-0e29-4351-bb41-a646bc9e54a1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: POST /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376/os-volume_attachments HTTP/1.1 May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 74 May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:33:20.873329 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:33:20.875404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:33:20.875404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:33:20.875404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:33:20.875404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:33:20.875404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:33:20.875404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:33:20.875404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:33:20.875404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:33:20.875404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:33:20.875404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: May 13 13:33:20.875404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {"volumeAttachment": {"volumeId": "f457fc60-31de-4afa-ae99-1f2af8b8275d"}} May 13 13:33:20.875404 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Invalid volume: volume f457fc60-31de-4afa-ae99-1f2af8b8275d is already attached to instances: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'server_id': '75183d1d-a3aa-4781-8289-ff286fe85376', 'body': {'volumeAttachment': {'volumeId': 'f457fc60-31de-4afa-ae99-1f2af8b8275d'}}} May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f457fc60-31de-4afa-ae99-1f2af8b8275d is already attached to instances: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:20.877056 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f457fc60-31de-4afa-ae99-1f2af8b8275d is already attached to instances: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:20.879344 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:20.882485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:20.882485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:33:20.882485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:33:20.882485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f457fc60-31de-4afa-ae99-1f2af8b8275d is already attached to instances: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 May 13 13:33:20.882485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:33:20.882485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-994d5198-0e29-4351-bb41-a646bc9e54a1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 400 to user: Invalid volume: volume f457fc60-31de-4afa-ae99-1f2af8b8275d is already attached to instances: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:33:20.882485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-994d5198-0e29-4351-bb41-a646bc9e54a1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097632 May 13 13:33:20.882485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 511/996] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:33:20 2022] POST /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 13 13:33:20.884535 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-fb6a3f3b-7f04-4ae6-8e52-00d1241fb906 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:20.885193 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-fb6a3f3b-7f04-4ae6-8e52-00d1241fb906 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:20.892431 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fb6a3f3b-7f04-4ae6-8e52-00d1241fb906 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:20.892977 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fb6a3f3b-7f04-4ae6-8e52-00d1241fb906 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:20.893898 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fb6a3f3b-7f04-4ae6-8e52-00d1241fb906 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:20.894392 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fb6a3f3b-7f04-4ae6-8e52-00d1241fb906 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:20.921965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-fb6a3f3b-7f04-4ae6-8e52-00d1241fb906 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Going to try to terminate instance {{(pid=117602) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:33:21.343929 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-fb6a3f3b-7f04-4ae6-8e52-00d1241fb906 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 204 len: 0 microversion: 2.1 time: 0.462867 May 13 13:33:21.344541 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 486/997] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:33:20 2022] DELETE /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:33:21.352869 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6383659d-3986-42fe-94d4-c58cf3ef85f6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:21.355491 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6383659d-3986-42fe-94d4-c58cf3ef85f6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:21.360091 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6383659d-3986-42fe-94d4-c58cf3ef85f6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:21.361071 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6383659d-3986-42fe-94d4-c58cf3ef85f6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:21.361881 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6383659d-3986-42fe-94d4-c58cf3ef85f6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:21.362470 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6383659d-3986-42fe-94d4-c58cf3ef85f6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:21.495608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6383659d-3986-42fe-94d4-c58cf3ef85f6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:21.503386 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6383659d-3986-42fe-94d4-c58cf3ef85f6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1680 microversion: 2.1 time: 0.154553 May 13 13:33:21.503965 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 512/998] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:21 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:33:22.521066 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f3dc9bab-bc57-43ea-aace-511ade8dacf0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:22.521806 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f3dc9bab-bc57-43ea-aace-511ade8dacf0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:22.528047 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f3dc9bab-bc57-43ea-aace-511ade8dacf0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:22.528499 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f3dc9bab-bc57-43ea-aace-511ade8dacf0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:22.529259 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f3dc9bab-bc57-43ea-aace-511ade8dacf0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:22.529693 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f3dc9bab-bc57-43ea-aace-511ade8dacf0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:22.672014 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-f3dc9bab-bc57-43ea-aace-511ade8dacf0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:22.679652 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f3dc9bab-bc57-43ea-aace-511ade8dacf0 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1680 microversion: 2.1 time: 0.162812 May 13 13:33:22.680297 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 487/999] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:22 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:23.696405 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5a0f349f-1a18-4e89-960e-4001c1c7ecf8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:23.697023 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5a0f349f-1a18-4e89-960e-4001c1c7ecf8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:23.703819 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5a0f349f-1a18-4e89-960e-4001c1c7ecf8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:23.705065 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5a0f349f-1a18-4e89-960e-4001c1c7ecf8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:23.705880 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5a0f349f-1a18-4e89-960e-4001c1c7ecf8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:23.706326 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5a0f349f-1a18-4e89-960e-4001c1c7ecf8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:23.773497 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5a0f349f-1a18-4e89-960e-4001c1c7ecf8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:23.781671 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5a0f349f-1a18-4e89-960e-4001c1c7ecf8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1613 microversion: 2.1 time: 0.089015 May 13 13:33:23.788659 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 513/1000] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:23 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:24.216637 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-441d7a18-b3da-42f1-82f3-d58ad0babe40 req-7a83b518-811a-495f-9850-1101df243145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75183d1d-a3aa-4781-8289-ff286fe85376", "name": "network-vif-deleted", "tag": "f187807d-97c8-42df-9d28-a62462466845"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:33:24.227455 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-441d7a18-b3da-42f1-82f3-d58ad0babe40 req-7a83b518-811a-495f-9850-1101df243145 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:24.228746 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-441d7a18-b3da-42f1-82f3-d58ad0babe40 req-7a83b518-811a-495f-9850-1101df243145 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:24.239874 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-441d7a18-b3da-42f1-82f3-d58ad0babe40 req-7a83b518-811a-495f-9850-1101df243145 service nova] Creating event network-vif-deleted:f187807d-97c8-42df-9d28-a62462466845 for instance 75183d1d-a3aa-4781-8289-ff286fe85376 on hv-cinder-84159 May 13 13:33:24.244999 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-441d7a18-b3da-42f1-82f3-d58ad0babe40 req-7a83b518-811a-495f-9850-1101df243145 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032312 May 13 13:33:24.245673 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 488/1001] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:24.799693 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-200c87b4-ab05-433e-9c07-5695b7531487 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:24.800330 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-200c87b4-ab05-433e-9c07-5695b7531487 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:24.807624 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-200c87b4-ab05-433e-9c07-5695b7531487 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:24.817445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-200c87b4-ab05-433e-9c07-5695b7531487 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:24.817445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-200c87b4-ab05-433e-9c07-5695b7531487 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:24.817445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-200c87b4-ab05-433e-9c07-5695b7531487 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:24.840434 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-200c87b4-ab05-433e-9c07-5695b7531487 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:24.840885 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-200c87b4-ab05-433e-9c07-5695b7531487 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:24.841335 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-200c87b4-ab05-433e-9c07-5695b7531487 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lazy-loading 'fault' on Instance uuid 75183d1d-a3aa-4781-8289-ff286fe85376 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:33:24.882788 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-200c87b4-ab05-433e-9c07-5695b7531487 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:24.890269 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-200c87b4-ab05-433e-9c07-5695b7531487 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 200 len: 1331 microversion: 2.1 time: 0.095095 May 13 13:33:24.890838 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 514/1002] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:24 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:25.909852 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ed2d04bf-ddcf-4f59-b97e-2358f4056d37 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:25.910602 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ed2d04bf-ddcf-4f59-b97e-2358f4056d37 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:25.917346 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ed2d04bf-ddcf-4f59-b97e-2358f4056d37 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:25.917831 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ed2d04bf-ddcf-4f59-b97e-2358f4056d37 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:25.918638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ed2d04bf-ddcf-4f59-b97e-2358f4056d37 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:25.919087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ed2d04bf-ddcf-4f59-b97e-2358f4056d37 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:25.934782 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-ed2d04bf-ddcf-4f59-b97e-2358f4056d37 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ed2d04bf-ddcf-4f59-b97e-2358f4056d37 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 HTTP/1.1 May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:33:25.936726 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:33:25.938441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:33:25.938441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:33:25.938441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:33:25.938441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:33:25.938441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:33:25.938441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:33:25.938441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:33:25.938441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:33:25.938441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:33:25.938441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:33:25.938441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:33:25.938441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '75183d1d-a3aa-4781-8289-ff286fe85376'} May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:33:25.939889 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:33:25.941452 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:25.943355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ed2d04bf-ddcf-4f59-b97e-2358f4056d37 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 404 to user: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:33:25.943355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ed2d04bf-ddcf-4f59-b97e-2358f4056d37 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 404 len: 111 microversion: 2.1 time: 0.033883 May 13 13:33:25.943355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 489/1003] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:25 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:33:25.950779 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1a315fb0-4ba3-4e62-8b12-be7640d6dc99 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '.version_select at 0x7faaa1c74dc0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:26.054491 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1a315fb0-4ba3-4e62-8b12-be7640d6dc99 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-963685804" status: 202 len: 0 microversion: 2.1 time: 0.107671 May 13 13:33:26.055105 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 515/1004] 10.222.0.25 () {58 vars in 1217 bytes} [Fri May 13 13:33:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-963685804 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:33:26.908090 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-03b44542-3f09-4568-b814-fcb4926a8774 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:26.908938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-03b44542-3f09-4568-b814-fcb4926a8774 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:26.915043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03b44542-3f09-4568-b814-fcb4926a8774 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:26.915627 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03b44542-3f09-4568-b814-fcb4926a8774 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:26.916259 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03b44542-3f09-4568-b814-fcb4926a8774 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:26.916700 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-03b44542-3f09-4568-b814-fcb4926a8774 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:26.996800 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-03b44542-3f09-4568-b814-fcb4926a8774 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lazy-loading 'services' on Instance uuid adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:33:27.263548 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-03b44542-3f09-4568-b814-fcb4926a8774 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments/f457fc60-31de-4afa-ae99-1f2af8b8275d" status: 202 len: 0 microversion: 2.1 time: 0.359223 May 13 13:33:27.268095 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 490/1005] 10.222.0.25 () {58 vars in 1415 bytes} [Fri May 13 13:33:26 2022] DELETE /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments/f457fc60-31de-4afa-ae99-1f2af8b8275d => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:33:27.273063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a20eafbc-f398-4b88-b263-a79092f3b95c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:27.274209 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a20eafbc-f398-4b88-b263-a79092f3b95c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:27.280883 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a20eafbc-f398-4b88-b263-a79092f3b95c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:27.281338 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a20eafbc-f398-4b88-b263-a79092f3b95c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:27.282260 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a20eafbc-f398-4b88-b263-a79092f3b95c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:27.282573 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a20eafbc-f398-4b88-b263-a79092f3b95c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:27.311831 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a20eafbc-f398-4b88-b263-a79092f3b95c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043138 May 13 13:33:27.312410 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 516/1006] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:33:27 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:28.328888 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5df40344-d1aa-4b4e-99c9-554432fe2bdd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:28.329945 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-5df40344-d1aa-4b4e-99c9-554432fe2bdd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:28.336880 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5df40344-d1aa-4b4e-99c9-554432fe2bdd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:28.337333 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5df40344-d1aa-4b4e-99c9-554432fe2bdd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:28.338225 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5df40344-d1aa-4b4e-99c9-554432fe2bdd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:28.338667 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5df40344-d1aa-4b4e-99c9-554432fe2bdd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:28.373023 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-5df40344-d1aa-4b4e-99c9-554432fe2bdd tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052144 May 13 13:33:28.373819 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 491/1007] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:33:28 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:29.384298 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6dbfe546-2394-4d36-a2da-47b80df9d4d8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:29.385226 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6dbfe546-2394-4d36-a2da-47b80df9d4d8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:29.392908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6dbfe546-2394-4d36-a2da-47b80df9d4d8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:29.393364 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6dbfe546-2394-4d36-a2da-47b80df9d4d8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:29.394182 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6dbfe546-2394-4d36-a2da-47b80df9d4d8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:29.394624 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6dbfe546-2394-4d36-a2da-47b80df9d4d8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:29.425946 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6dbfe546-2394-4d36-a2da-47b80df9d4d8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 May 13 13:33:29.426522 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 517/1008] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:33:29 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:30.436593 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c3769aad-0698-4e1b-b25e-292dce77cf85 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:30.437560 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c3769aad-0698-4e1b-b25e-292dce77cf85 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:30.444476 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c3769aad-0698-4e1b-b25e-292dce77cf85 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:30.444934 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c3769aad-0698-4e1b-b25e-292dce77cf85 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:30.445719 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c3769aad-0698-4e1b-b25e-292dce77cf85 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:30.446198 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c3769aad-0698-4e1b-b25e-292dce77cf85 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:30.475525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c3769aad-0698-4e1b-b25e-292dce77cf85 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042911 May 13 13:33:30.476099 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 492/1009] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:33:30 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:31.487838 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ddc123e5-021d-4a20-bd5e-eed075d2a4d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:31.488764 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ddc123e5-021d-4a20-bd5e-eed075d2a4d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:31.495273 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ddc123e5-021d-4a20-bd5e-eed075d2a4d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:31.496149 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ddc123e5-021d-4a20-bd5e-eed075d2a4d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:31.496939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ddc123e5-021d-4a20-bd5e-eed075d2a4d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:31.497401 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ddc123e5-021d-4a20-bd5e-eed075d2a4d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:31.528443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ddc123e5-021d-4a20-bd5e-eed075d2a4d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 May 13 13:33:31.529011 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 518/1010] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:33:31 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:32.539721 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0c3c618e-58fd-437d-9355-d3c109726fff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:32.540644 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0c3c618e-58fd-437d-9355-d3c109726fff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:32.546888 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0c3c618e-58fd-437d-9355-d3c109726fff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:32.547339 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0c3c618e-58fd-437d-9355-d3c109726fff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:32.548107 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0c3c618e-58fd-437d-9355-d3c109726fff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:32.549065 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0c3c618e-58fd-437d-9355-d3c109726fff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:32.577489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0c3c618e-58fd-437d-9355-d3c109726fff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041771 May 13 13:33:32.578018 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 493/1011] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:33:32 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:33.589212 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-66560faa-04ae-4cfe-9213-d6816ce16aaa tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:33.590170 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-66560faa-04ae-4cfe-9213-d6816ce16aaa tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:33.596701 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66560faa-04ae-4cfe-9213-d6816ce16aaa tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:33.597159 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66560faa-04ae-4cfe-9213-d6816ce16aaa tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:33.597957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66560faa-04ae-4cfe-9213-d6816ce16aaa tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:33.598405 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-66560faa-04ae-4cfe-9213-d6816ce16aaa tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:33.626127 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-66560faa-04ae-4cfe-9213-d6816ce16aaa tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040845 May 13 13:33:33.627176 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 519/1012] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:33:33 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:34.637586 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0ea94cd1-d6d4-44d9-a9be-d76cce8c36b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:34.638623 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0ea94cd1-d6d4-44d9-a9be-d76cce8c36b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:34.645470 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0ea94cd1-d6d4-44d9-a9be-d76cce8c36b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:34.645960 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0ea94cd1-d6d4-44d9-a9be-d76cce8c36b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:34.646740 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0ea94cd1-d6d4-44d9-a9be-d76cce8c36b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:34.647182 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0ea94cd1-d6d4-44d9-a9be-d76cce8c36b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:34.676182 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0ea94cd1-d6d4-44d9-a9be-d76cce8c36b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042486 May 13 13:33:34.676668 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 494/1013] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:33:34 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:35.687733 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ecc027b1-3c1a-4efe-9c9d-48dc097e128a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:35.688660 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ecc027b1-3c1a-4efe-9c9d-48dc097e128a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:35.695038 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ecc027b1-3c1a-4efe-9c9d-48dc097e128a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:35.695495 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ecc027b1-3c1a-4efe-9c9d-48dc097e128a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:35.696270 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ecc027b1-3c1a-4efe-9c9d-48dc097e128a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:35.696712 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ecc027b1-3c1a-4efe-9c9d-48dc097e128a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:35.725442 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ecc027b1-3c1a-4efe-9c9d-48dc097e128a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041670 May 13 13:33:35.726036 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 520/1014] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:33:35 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:33:36.736607 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-22379956-1504-4079-a6f6-79696159c23c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:36.737564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-22379956-1504-4079-a6f6-79696159c23c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:36.743851 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-22379956-1504-4079-a6f6-79696159c23c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:36.744310 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-22379956-1504-4079-a6f6-79696159c23c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:36.745080 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-22379956-1504-4079-a6f6-79696159c23c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:36.745519 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-22379956-1504-4079-a6f6-79696159c23c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:36.787637 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-22379956-1504-4079-a6f6-79696159c23c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054887 May 13 13:33:36.788413 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 495/1015] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:33:36 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:33:36.846217 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-bd8e2911-7f55-4210-8555-24ed6c28a102 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:36.846790 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bd8e2911-7f55-4210-8555-24ed6c28a102 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:36.852977 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bd8e2911-7f55-4210-8555-24ed6c28a102 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:36.853990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bd8e2911-7f55-4210-8555-24ed6c28a102 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:36.854317 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bd8e2911-7f55-4210-8555-24ed6c28a102 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:36.854763 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-bd8e2911-7f55-4210-8555-24ed6c28a102 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:36.880557 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-bd8e2911-7f55-4210-8555-24ed6c28a102 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:33:37.253439 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-bd8e2911-7f55-4210-8555-24ed6c28a102 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 204 len: 0 microversion: 2.1 time: 0.410532 May 13 13:33:37.254161 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 521/1016] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:33:36 2022] DELETE /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:33:37.262145 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-bf234645-18c3-43ba-b225-05d91f99f8b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:37.265824 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-bf234645-18c3-43ba-b225-05d91f99f8b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:37.269561 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bf234645-18c3-43ba-b225-05d91f99f8b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:37.270060 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bf234645-18c3-43ba-b225-05d91f99f8b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:37.270891 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bf234645-18c3-43ba-b225-05d91f99f8b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:37.271336 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-bf234645-18c3-43ba-b225-05d91f99f8b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:37.401552 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-bf234645-18c3-43ba-b225-05d91f99f8b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:37.409537 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-bf234645-18c3-43ba-b225-05d91f99f8b8 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1681 microversion: 2.1 time: 0.151198 May 13 13:33:37.410139 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 496/1017] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:37 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:33:38.427941 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2365bdf8-05c6-4298-af3d-a3fba0fc2d23 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:38.428643 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2365bdf8-05c6-4298-af3d-a3fba0fc2d23 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:38.434893 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2365bdf8-05c6-4298-af3d-a3fba0fc2d23 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:38.438596 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2365bdf8-05c6-4298-af3d-a3fba0fc2d23 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:38.438596 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2365bdf8-05c6-4298-af3d-a3fba0fc2d23 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:38.438596 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2365bdf8-05c6-4298-af3d-a3fba0fc2d23 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:38.567296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2365bdf8-05c6-4298-af3d-a3fba0fc2d23 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:38.574503 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2365bdf8-05c6-4298-af3d-a3fba0fc2d23 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1681 microversion: 2.1 time: 0.151407 May 13 13:33:38.575092 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 522/1018] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:38 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:39.592153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-316ed508-a815-4ab0-bf03-cad186001efe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:39.592683 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-316ed508-a815-4ab0-bf03-cad186001efe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:39.599307 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-316ed508-a815-4ab0-bf03-cad186001efe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:39.599760 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-316ed508-a815-4ab0-bf03-cad186001efe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:39.600548 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-316ed508-a815-4ab0-bf03-cad186001efe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:39.600992 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-316ed508-a815-4ab0-bf03-cad186001efe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:39.733841 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-316ed508-a815-4ab0-bf03-cad186001efe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:39.742304 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-316ed508-a815-4ab0-bf03-cad186001efe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1681 microversion: 2.1 time: 0.153885 May 13 13:33:39.742866 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 497/1019] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:39 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:40.759724 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e2390c9f-9d3b-44ad-9801-d7505d538156 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:40.760347 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e2390c9f-9d3b-44ad-9801-d7505d538156 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:40.767310 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2390c9f-9d3b-44ad-9801-d7505d538156 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:40.767769 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2390c9f-9d3b-44ad-9801-d7505d538156 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:40.768552 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2390c9f-9d3b-44ad-9801-d7505d538156 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:40.769000 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2390c9f-9d3b-44ad-9801-d7505d538156 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:40.898168 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e2390c9f-9d3b-44ad-9801-d7505d538156 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:40.905603 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e2390c9f-9d3b-44ad-9801-d7505d538156 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1681 microversion: 2.1 time: 0.149652 May 13 13:33:40.906213 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 523/1020] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:40 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:41.923582 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a8329c98-2c5b-44ac-b58c-f2225757bb94 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:41.924331 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a8329c98-2c5b-44ac-b58c-f2225757bb94 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:41.931359 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8329c98-2c5b-44ac-b58c-f2225757bb94 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:41.931809 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8329c98-2c5b-44ac-b58c-f2225757bb94 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:41.932629 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8329c98-2c5b-44ac-b58c-f2225757bb94 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:41.933012 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a8329c98-2c5b-44ac-b58c-f2225757bb94 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:42.090801 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a8329c98-2c5b-44ac-b58c-f2225757bb94 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:42.098285 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a8329c98-2c5b-44ac-b58c-f2225757bb94 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1681 microversion: 2.1 time: 0.178526 May 13 13:33:42.099478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 498/1021] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:41 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:42.423574 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-ff65083b-da07-46b6-9063-334dec39d71f req-f4102f01-1708-483a-9c81-abd3ccd84f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adbc38e8-eda7-4bc6-86c3-be36a0ed8e78", "name": "network-vif-deleted", "tag": "d5df665f-4727-4295-aefc-8229d56a25ad"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:33:42.433816 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ff65083b-da07-46b6-9063-334dec39d71f req-f4102f01-1708-483a-9c81-abd3ccd84f57 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:42.434857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-ff65083b-da07-46b6-9063-334dec39d71f req-f4102f01-1708-483a-9c81-abd3ccd84f57 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:42.445720 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-ff65083b-da07-46b6-9063-334dec39d71f req-f4102f01-1708-483a-9c81-abd3ccd84f57 service nova] Creating event network-vif-deleted:d5df665f-4727-4295-aefc-8229d56a25ad for instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 on hv-cinder-84159 May 13 13:33:42.450945 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-ff65083b-da07-46b6-9063-334dec39d71f req-f4102f01-1708-483a-9c81-abd3ccd84f57 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031018 May 13 13:33:42.451898 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 524/1022] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:43.115876 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e61670df-61b8-4025-ae2f-74d876d95d49 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:43.116507 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e61670df-61b8-4025-ae2f-74d876d95d49 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:43.122979 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e61670df-61b8-4025-ae2f-74d876d95d49 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:43.123441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e61670df-61b8-4025-ae2f-74d876d95d49 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:43.124230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e61670df-61b8-4025-ae2f-74d876d95d49 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:43.124676 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e61670df-61b8-4025-ae2f-74d876d95d49 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:43.188711 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e61670df-61b8-4025-ae2f-74d876d95d49 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:43.196482 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e61670df-61b8-4025-ae2f-74d876d95d49 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1325 microversion: 2.1 time: 0.084784 May 13 13:33:43.196858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 499/1023] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:43 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1325 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:44.214413 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2473a27c-1a53-4804-852e-4e1aeae9bac9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:44.215136 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2473a27c-1a53-4804-852e-4e1aeae9bac9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:44.221214 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2473a27c-1a53-4804-852e-4e1aeae9bac9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:44.221662 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2473a27c-1a53-4804-852e-4e1aeae9bac9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:44.222462 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2473a27c-1a53-4804-852e-4e1aeae9bac9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:44.222898 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2473a27c-1a53-4804-852e-4e1aeae9bac9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:44.302443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2473a27c-1a53-4804-852e-4e1aeae9bac9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:44.309716 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2473a27c-1a53-4804-852e-4e1aeae9bac9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 200 len: 1325 microversion: 2.1 time: 0.099990 May 13 13:33:44.310314 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 525/1024] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:44 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 1325 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:45.330979 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6fbebde9-ade6-4565-b0c4-c26fdf8d5e17 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:45.332096 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6fbebde9-ade6-4565-b0c4-c26fdf8d5e17 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:45.338885 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6fbebde9-ade6-4565-b0c4-c26fdf8d5e17 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:45.339339 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6fbebde9-ade6-4565-b0c4-c26fdf8d5e17 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:45.340122 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6fbebde9-ade6-4565-b0c4-c26fdf8d5e17 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:45.340667 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6fbebde9-ade6-4565-b0c4-c26fdf8d5e17 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:45.355197 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-6fbebde9-ade6-4565-b0c4-c26fdf8d5e17 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6fbebde9-ade6-4565-b0c4-c26fdf8d5e17 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 HTTP/1.1 May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:33:45.356858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:33:45.358752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:33:45.358752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:33:45.358752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:33:45.358752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:33:45.358752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:33:45.358752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:33:45.358752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:33:45.358752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:33:45.358752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:33:45.358752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:33:45.358752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:33:45.358752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': 'adbc38e8-eda7-4bc6-86c3-be36a0ed8e78'} May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:33:45.360450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:33:45.362564 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:33:45.364895 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6fbebde9-ade6-4565-b0c4-c26fdf8d5e17 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 404 to user: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:33:45.364895 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6fbebde9-ade6-4565-b0c4-c26fdf8d5e17 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 404 len: 111 microversion: 2.1 time: 0.031455 May 13 13:33:45.364895 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 500/1025] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:45 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:33:45.367129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c7a4bd54-d65b-433f-9947-e7e0601c43e9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '.version_select at 0x7faaa1c2de50>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:45.471406 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c7a4bd54-d65b-433f-9947-e7e0601c43e9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-267286585" status: 202 len: 0 microversion: 2.1 time: 0.107981 May 13 13:33:45.472150 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 526/1026] 10.222.0.25 () {58 vars in 1217 bytes} [Fri May 13 13:33:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-267286585 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:33:46.307054 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-092aec1b-7b66-4e96-a1bc-3dcc207d7e1e tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: .version_select at 0x7faaa1e93a60>, body: {"keypair": {"name": "tempest-keypair-208460516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImkkl46UIIAwP3sYFlSrhGdg0NF0EAsljW/fataxNZaGUr/WGag8d+H4+U7K1ETDnKgeoSjVI03ELr3EHXWbTFXdt4yFO5e0Tm6vF1OYpqa+ie/3mUzNHNaBt8/7EN7zA=="}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:33:46.321154 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-092aec1b-7b66-4e96-a1bc-3dcc207d7e1e tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for project 1e72f39546704606927bcefdc0f13235. Resources: {'key_pairs'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:33:46.324885 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-092aec1b-7b66-4e96-a1bc-3dcc207d7e1e tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for user 79dbde2a65224927af4bb5e77090496c and project 1e72f39546704606927bcefdc0f13235. Resources: {'key_pairs'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:33:46.459553 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-092aec1b-7b66-4e96-a1bc-3dcc207d7e1e tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156308 May 13 13:33:46.460843 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 501/1027] 10.222.0.25 () {60 vars in 1158 bytes} [Fri May 13 13:33:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:48.930625 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-592065953", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46cd8800-6675-4b3d-a84e-b42f58021a8c"}], "security_groups": [{"name": "tempest-securitygroup--1445061096"}], "key_name": "tempest-keypair-208460516", "user_data": "}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:33:49.033829 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.network.neutron [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] validate_networks() for [('46cd8800-6675-4b3d-a84e-b42f58021a8c', None, None, None, None, None)] {{(pid=117603) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:33:49.407999 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Flavor limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:33:49.408431 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Image limits 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:33:49.408914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Flavor pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:33:49.409886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Image pref 0:0:0 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:33:49.410348 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.virt.hardware [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117603) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:33:49.419337 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:49.419796 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:49.420613 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:49.421053 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:49.439372 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for project 1e72f39546704606927bcefdc0f13235. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:33:49.443414 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for user 79dbde2a65224927af4bb5e77090496c and project 1e72f39546704606927bcefdc0f13235. Resources: {'instances', 'cores', 'ram'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:33:49.455315 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Going to run 1 instances... {{(pid=117603) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:33:49.457626 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117603) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:33:49.598264 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-653f9294-8425-4cb6-a293-0d94b69b2410 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.671737 May 13 13:33:49.598831 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 527/1028] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:33:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:33:49.609216 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-96f967a2-ce91-4035-9e2a-6d01eae05179 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:49.610045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-96f967a2-ce91-4035-9e2a-6d01eae05179 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:49.670086 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-96f967a2-ce91-4035-9e2a-6d01eae05179 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:49.676982 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-96f967a2-ce91-4035-9e2a-6d01eae05179 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1240 microversion: 2.1 time: 0.072177 May 13 13:33:49.677543 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 502/1029] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:49 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:50.695165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-545b9645-a71f-43b4-a37d-81080bd50d77 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:50.695786 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-545b9645-a71f-43b4-a37d-81080bd50d77 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:50.702092 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-545b9645-a71f-43b4-a37d-81080bd50d77 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:50.702553 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-545b9645-a71f-43b4-a37d-81080bd50d77 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:50.703341 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-545b9645-a71f-43b4-a37d-81080bd50d77 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:50.703787 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-545b9645-a71f-43b4-a37d-81080bd50d77 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:50.767418 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-545b9645-a71f-43b4-a37d-81080bd50d77 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:50.775129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-545b9645-a71f-43b4-a37d-81080bd50d77 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1244 microversion: 2.1 time: 0.084932 May 13 13:33:50.775697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 528/1030] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:50 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:51.794832 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6ffa2d97-331f-43f8-a9a7-a6df2061cb18 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:51.795629 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6ffa2d97-331f-43f8-a9a7-a6df2061cb18 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:51.809383 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6ffa2d97-331f-43f8-a9a7-a6df2061cb18 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:51.809865 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6ffa2d97-331f-43f8-a9a7-a6df2061cb18 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:51.810701 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6ffa2d97-331f-43f8-a9a7-a6df2061cb18 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:51.811136 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6ffa2d97-331f-43f8-a9a7-a6df2061cb18 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:51.895776 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-6ffa2d97-331f-43f8-a9a7-a6df2061cb18 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:51.908349 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6ffa2d97-331f-43f8-a9a7-a6df2061cb18 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1298 microversion: 2.1 time: 0.119771 May 13 13:33:51.945359 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 503/1031] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:51 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:52.954031 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-816dbfe2-36bc-4a40-8cdf-ce5c81165b4b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:52.954031 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-816dbfe2-36bc-4a40-8cdf-ce5c81165b4b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:52.961259 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-816dbfe2-36bc-4a40-8cdf-ce5c81165b4b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:52.962067 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-816dbfe2-36bc-4a40-8cdf-ce5c81165b4b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:52.962852 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-816dbfe2-36bc-4a40-8cdf-ce5c81165b4b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:52.963347 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-816dbfe2-36bc-4a40-8cdf-ce5c81165b4b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:53.104594 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-816dbfe2-36bc-4a40-8cdf-ce5c81165b4b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:53.112299 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-816dbfe2-36bc-4a40-8cdf-ce5c81165b4b tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1366 microversion: 2.1 time: 0.163635 May 13 13:33:53.112827 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 529/1032] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:52 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:53.203999 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-cc4b3f49-f7f2-4d2f-824b-f85d28657440 req-a35a52fa-7030-4d17-bfd1-587d17ff100e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e839d2a-15b4-48ad-a357-ad4a871f1818", "tag": "d3fd9ca9-9f12-460c-bf10-dc86aa9b63ab"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:33:53.211596 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-cc4b3f49-f7f2-4d2f-824b-f85d28657440 req-a35a52fa-7030-4d17-bfd1-587d17ff100e service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:53.212075 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-cc4b3f49-f7f2-4d2f-824b-f85d28657440 req-a35a52fa-7030-4d17-bfd1-587d17ff100e service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:53.223409 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-cc4b3f49-f7f2-4d2f-824b-f85d28657440 req-a35a52fa-7030-4d17-bfd1-587d17ff100e service nova] Creating event network-changed:d3fd9ca9-9f12-460c-bf10-dc86aa9b63ab for instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 on hv-cinder-84159 May 13 13:33:53.228811 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-cc4b3f49-f7f2-4d2f-824b-f85d28657440 req-a35a52fa-7030-4d17-bfd1-587d17ff100e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035454 May 13 13:33:53.229576 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 504/1033] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:54.129203 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-76fa4637-3acc-48e3-b288-1a618300570f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:54.129778 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-76fa4637-3acc-48e3-b288-1a618300570f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:54.136147 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76fa4637-3acc-48e3-b288-1a618300570f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:54.136984 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76fa4637-3acc-48e3-b288-1a618300570f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:54.137455 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76fa4637-3acc-48e3-b288-1a618300570f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:54.137930 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76fa4637-3acc-48e3-b288-1a618300570f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:54.277896 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-76fa4637-3acc-48e3-b288-1a618300570f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:54.284664 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-76fa4637-3acc-48e3-b288-1a618300570f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1366 microversion: 2.1 time: 0.159950 May 13 13:33:54.285261 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 530/1034] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:54 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:55.304030 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7eec5432-9823-4108-b8a4-e1f248a8dafe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:55.304877 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7eec5432-9823-4108-b8a4-e1f248a8dafe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:55.311232 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7eec5432-9823-4108-b8a4-e1f248a8dafe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:55.311692 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7eec5432-9823-4108-b8a4-e1f248a8dafe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:55.312562 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7eec5432-9823-4108-b8a4-e1f248a8dafe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:55.313005 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7eec5432-9823-4108-b8a4-e1f248a8dafe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:55.462023 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-7eec5432-9823-4108-b8a4-e1f248a8dafe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:55.469433 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7eec5432-9823-4108-b8a4-e1f248a8dafe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1366 microversion: 2.1 time: 0.171393 May 13 13:33:55.475999 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 505/1035] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:55 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:56.488901 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e2ec1d4d-4464-4dec-b83f-ca2dcef8c8b1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:56.489526 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e2ec1d4d-4464-4dec-b83f-ca2dcef8c8b1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:56.496359 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2ec1d4d-4464-4dec-b83f-ca2dcef8c8b1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:56.496821 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2ec1d4d-4464-4dec-b83f-ca2dcef8c8b1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:56.497608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2ec1d4d-4464-4dec-b83f-ca2dcef8c8b1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:56.498088 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e2ec1d4d-4464-4dec-b83f-ca2dcef8c8b1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:56.634060 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e2ec1d4d-4464-4dec-b83f-ca2dcef8c8b1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:56.641384 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e2ec1d4d-4464-4dec-b83f-ca2dcef8c8b1 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1366 microversion: 2.1 time: 0.157765 May 13 13:33:56.641996 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 531/1036] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:56 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:57.658512 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-a463bb24-ed23-4a5b-a1ff-19f3a93d0e7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:57.659125 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-a463bb24-ed23-4a5b-a1ff-19f3a93d0e7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:57.665397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a463bb24-ed23-4a5b-a1ff-19f3a93d0e7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:57.665883 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a463bb24-ed23-4a5b-a1ff-19f3a93d0e7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:57.666653 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a463bb24-ed23-4a5b-a1ff-19f3a93d0e7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:57.667090 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-a463bb24-ed23-4a5b-a1ff-19f3a93d0e7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:57.801924 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-a463bb24-ed23-4a5b-a1ff-19f3a93d0e7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:57.809552 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-a463bb24-ed23-4a5b-a1ff-19f3a93d0e7a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1366 microversion: 2.1 time: 0.154891 May 13 13:33:57.810143 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 506/1037] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:57 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:58.827014 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9db5416f-43af-487a-8f85-4c81549800ca tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:58.827625 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9db5416f-43af-487a-8f85-4c81549800ca tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:58.834295 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9db5416f-43af-487a-8f85-4c81549800ca tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:58.834752 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9db5416f-43af-487a-8f85-4c81549800ca tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:58.835515 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9db5416f-43af-487a-8f85-4c81549800ca tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:58.835955 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9db5416f-43af-487a-8f85-4c81549800ca tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:58.963939 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9db5416f-43af-487a-8f85-4c81549800ca tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:33:58.969172 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-fab2ba9a-0410-41b4-9815-304d7e867627 req-ddeb0721-36b1-4454-86de-786168d83ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e839d2a-15b4-48ad-a357-ad4a871f1818", "name": "network-vif-plugged", "status": "completed", "tag": "d3fd9ca9-9f12-460c-bf10-dc86aa9b63ab"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:33:58.972949 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9db5416f-43af-487a-8f85-4c81549800ca tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1366 microversion: 2.1 time: 0.149085 May 13 13:33:58.973613 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 532/1038] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:58 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:33:58.978478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-fab2ba9a-0410-41b4-9815-304d7e867627 req-ddeb0721-36b1-4454-86de-786168d83ee1 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:58.978951 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-fab2ba9a-0410-41b4-9815-304d7e867627 req-ddeb0721-36b1-4454-86de-786168d83ee1 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:58.990447 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-fab2ba9a-0410-41b4-9815-304d7e867627 req-ddeb0721-36b1-4454-86de-786168d83ee1 service nova] Creating event network-vif-plugged:d3fd9ca9-9f12-460c-bf10-dc86aa9b63ab for instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 on hv-cinder-84159 May 13 13:33:58.995428 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-fab2ba9a-0410-41b4-9815-304d7e867627 req-ddeb0721-36b1-4454-86de-786168d83ee1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029857 May 13 13:33:58.996003 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 507/1039] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:33:59.990663 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-ed96bc46-b9d3-49f4-b9af-36f955756cec tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:33:59.991276 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-ed96bc46-b9d3-49f4-b9af-36f955756cec tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:33:59.997546 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ed96bc46-b9d3-49f4-b9af-36f955756cec tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:59.998033 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ed96bc46-b9d3-49f4-b9af-36f955756cec tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:33:59.998803 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ed96bc46-b9d3-49f4-b9af-36f955756cec tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:33:59.999248 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-ed96bc46-b9d3-49f4-b9af-36f955756cec tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:00.123992 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-ed96bc46-b9d3-49f4-b9af-36f955756cec tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:00.131162 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-ed96bc46-b9d3-49f4-b9af-36f955756cec tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1366 microversion: 2.1 time: 0.144873 May 13 13:34:00.131735 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 533/1040] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:33:59 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:01.148838 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-cb7a3896-b30c-4905-ae3f-8a1bb08fa1cb tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:01.149540 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-cb7a3896-b30c-4905-ae3f-8a1bb08fa1cb tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:01.155697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cb7a3896-b30c-4905-ae3f-8a1bb08fa1cb tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:01.156153 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cb7a3896-b30c-4905-ae3f-8a1bb08fa1cb tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:01.156924 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cb7a3896-b30c-4905-ae3f-8a1bb08fa1cb tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:01.157361 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cb7a3896-b30c-4905-ae3f-8a1bb08fa1cb tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:01.287263 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-cb7a3896-b30c-4905-ae3f-8a1bb08fa1cb tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:01.294525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-cb7a3896-b30c-4905-ae3f-8a1bb08fa1cb tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1366 microversion: 2.1 time: 0.150370 May 13 13:34:01.295093 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 508/1041] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:01 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:02.311915 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-05fbc784-a9a6-4146-9df4-56a04ac7a19d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:02.312532 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-05fbc784-a9a6-4146-9df4-56a04ac7a19d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:02.319602 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05fbc784-a9a6-4146-9df4-56a04ac7a19d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:02.320592 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05fbc784-a9a6-4146-9df4-56a04ac7a19d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:02.320839 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05fbc784-a9a6-4146-9df4-56a04ac7a19d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:02.321277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-05fbc784-a9a6-4146-9df4-56a04ac7a19d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:02.457752 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-05fbc784-a9a6-4146-9df4-56a04ac7a19d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:02.465359 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-05fbc784-a9a6-4146-9df4-56a04ac7a19d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1366 microversion: 2.1 time: 0.157302 May 13 13:34:02.465948 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 534/1042] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:02 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:03.481467 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-43964237-fcb1-4f80-b45f-12c560f0e5ab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:03.482109 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-43964237-fcb1-4f80-b45f-12c560f0e5ab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:03.488649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-43964237-fcb1-4f80-b45f-12c560f0e5ab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:03.489105 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-43964237-fcb1-4f80-b45f-12c560f0e5ab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:03.489940 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-43964237-fcb1-4f80-b45f-12c560f0e5ab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:03.490381 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-43964237-fcb1-4f80-b45f-12c560f0e5ab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:03.616840 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-43964237-fcb1-4f80-b45f-12c560f0e5ab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:03.624884 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-43964237-fcb1-4f80-b45f-12c560f0e5ab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1366 microversion: 2.1 time: 0.147352 May 13 13:34:03.625456 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 509/1043] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:03 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:04.642009 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e71228cd-9ebc-4051-ac94-017fc9ca9768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:04.642626 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e71228cd-9ebc-4051-ac94-017fc9ca9768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:04.649121 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e71228cd-9ebc-4051-ac94-017fc9ca9768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:04.649575 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e71228cd-9ebc-4051-ac94-017fc9ca9768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:04.650385 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e71228cd-9ebc-4051-ac94-017fc9ca9768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:04.650880 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e71228cd-9ebc-4051-ac94-017fc9ca9768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:04.778236 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e71228cd-9ebc-4051-ac94-017fc9ca9768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:04.786091 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e71228cd-9ebc-4051-ac94-017fc9ca9768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1555 microversion: 2.1 time: 0.147897 May 13 13:34:04.786686 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 535/1044] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:04 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:04.814649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-cb9457de-a5fa-4972-8387-07848593723a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:04.815181 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-cb9457de-a5fa-4972-8387-07848593723a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:04.821621 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cb9457de-a5fa-4972-8387-07848593723a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:04.822265 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cb9457de-a5fa-4972-8387-07848593723a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:04.823074 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cb9457de-a5fa-4972-8387-07848593723a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:04.823517 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cb9457de-a5fa-4972-8387-07848593723a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:04.902489 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-cb9457de-a5fa-4972-8387-07848593723a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091653 May 13 13:34:04.903092 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 510/1045] 10.222.0.25 () {58 vars in 1274 bytes} [Fri May 13 13:34:04 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:34:06.248854 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-706873e4-1efe-4fb0-ada5-6750d6a5fa36 req-e9969425-e0e4-462b-9398-3e25d88224a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e839d2a-15b4-48ad-a357-ad4a871f1818", "tag": "d3fd9ca9-9f12-460c-bf10-dc86aa9b63ab"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:06.258381 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-706873e4-1efe-4fb0-ada5-6750d6a5fa36 req-e9969425-e0e4-462b-9398-3e25d88224a7 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:06.258906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-706873e4-1efe-4fb0-ada5-6750d6a5fa36 req-e9969425-e0e4-462b-9398-3e25d88224a7 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:06.271671 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-706873e4-1efe-4fb0-ada5-6750d6a5fa36 req-e9969425-e0e4-462b-9398-3e25d88224a7 service nova] Creating event network-changed:d3fd9ca9-9f12-460c-bf10-dc86aa9b63ab for instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 on hv-cinder-84159 May 13 13:34:06.276688 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-706873e4-1efe-4fb0-ada5-6750d6a5fa36 req-e9969425-e0e4-462b-9398-3e25d88224a7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031460 May 13 13:34:06.278542 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 536/1046] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:34:36.479966 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1230426729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1357767532", "security_groups": [{"name": "tempest-secgroup-smoke-854436485"}], "block_device_mapping_v2": [{"uuid": "e8084cdc-0b95-4430-860b-99f0d2d96976", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6c9600aa-af97-422e-b469-899e3d008792"}]}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:36.590747 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.network.neutron [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] validate_networks() for [('6c9600aa-af97-422e-b469-899e3d008792', None, None, None, None, None)] {{(pid=117602) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:34:36.959135 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Flavor limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:34:36.959974 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Image limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:34:36.960453 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Flavor pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:34:36.960860 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Image pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:34:36.961269 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:34:36.969748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:36.970223 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:36.971023 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:36.971455 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:36.987339 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Getting quotas for project d3e32e04d1f44e97b903f98c7c2749db. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:34:36.991677 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Getting quotas for user 8101850dd18f4108ac12ff9487cbbe3e and project d3e32e04d1f44e97b903f98c7c2749db. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:34:37.045675 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Going to run 1 instances... {{(pid=117602) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:34:37.047794 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8084cdc-0b95-4430-860b-99f0d2d96976',volume_size=None,volume_type=None)] {{(pid=117602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:34:37.414995 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-965166c3-65b5-4d47-bd6b-b53245cd1bb5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.939487 May 13 13:34:37.415641 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 511/1047] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:34:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:34:37.427567 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-234168e9-636d-40f8-9bf6-9cedfb4b3caf tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:37.428296 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-234168e9-636d-40f8-9bf6-9cedfb4b3caf tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:37.483039 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-234168e9-636d-40f8-9bf6-9cedfb4b3caf tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:37.489707 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-234168e9-636d-40f8-9bf6-9cedfb4b3caf tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1095 microversion: 2.1 time: 0.067803 May 13 13:34:37.490565 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 537/1048] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:37 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:34:38.508061 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-18c7757a-2e2c-4d9b-b0dc-37578c505238 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:38.508708 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-18c7757a-2e2c-4d9b-b0dc-37578c505238 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:38.515157 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-18c7757a-2e2c-4d9b-b0dc-37578c505238 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:38.515623 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-18c7757a-2e2c-4d9b-b0dc-37578c505238 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:38.516406 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-18c7757a-2e2c-4d9b-b0dc-37578c505238 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:38.516851 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-18c7757a-2e2c-4d9b-b0dc-37578c505238 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:38.584072 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-18c7757a-2e2c-4d9b-b0dc-37578c505238 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:38.591668 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-18c7757a-2e2c-4d9b-b0dc-37578c505238 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1137 microversion: 2.1 time: 0.088640 May 13 13:34:38.592310 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 512/1049] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:38 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1137 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:39.611943 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c230aeaa-aba7-4aff-9e55-5598d6c548d6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:39.612612 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c230aeaa-aba7-4aff-9e55-5598d6c548d6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:39.619723 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c230aeaa-aba7-4aff-9e55-5598d6c548d6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:39.620195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c230aeaa-aba7-4aff-9e55-5598d6c548d6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:39.620959 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c230aeaa-aba7-4aff-9e55-5598d6c548d6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:39.621405 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c230aeaa-aba7-4aff-9e55-5598d6c548d6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:39.681960 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c230aeaa-aba7-4aff-9e55-5598d6c548d6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:39.689411 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c230aeaa-aba7-4aff-9e55-5598d6c548d6 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1211 microversion: 2.1 time: 0.081424 May 13 13:34:39.690011 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 538/1050] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:39 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:40.551018 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-802830ff-5ea6-41d0-a83d-616b7fdb40ef tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:40.551599 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-802830ff-5ea6-41d0-a83d-616b7fdb40ef tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:40.557996 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-802830ff-5ea6-41d0-a83d-616b7fdb40ef tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:40.558455 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-802830ff-5ea6-41d0-a83d-616b7fdb40ef tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:40.559243 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-802830ff-5ea6-41d0-a83d-616b7fdb40ef tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:40.559684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-802830ff-5ea6-41d0-a83d-616b7fdb40ef tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:40.582842 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-802830ff-5ea6-41d0-a83d-616b7fdb40ef tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/ips" status: 200 len: 149 microversion: 2.1 time: 0.035762 May 13 13:34:40.583914 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 513/1051] 10.222.0.25 () {58 vars in 1247 bytes} [Fri May 13 13:34:40 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:34:40.706694 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-97ce7e9d-c1cb-4a46-b147-14eca8ec2a94 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:40.707232 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-97ce7e9d-c1cb-4a46-b147-14eca8ec2a94 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:40.714386 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-97ce7e9d-c1cb-4a46-b147-14eca8ec2a94 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:40.715419 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-97ce7e9d-c1cb-4a46-b147-14eca8ec2a94 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:40.715576 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-97ce7e9d-c1cb-4a46-b147-14eca8ec2a94 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:40.716007 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-97ce7e9d-c1cb-4a46-b147-14eca8ec2a94 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:40.866055 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-97ce7e9d-c1cb-4a46-b147-14eca8ec2a94 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:40.873289 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-97ce7e9d-c1cb-4a46-b147-14eca8ec2a94 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1278 microversion: 2.1 time: 0.170443 May 13 13:34:40.873888 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 539/1052] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:40 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:41.319921 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-060bc208-2609-4f5a-8168-5b82d36c0b9f req-30745c4f-da23-4d1e-bb2d-11c93ba01c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ec7b2f-151a-4074-9dd9-b7a7b0e45c12", "tag": "acd2f1ab-4dd9-492b-8a9b-447c531381e8"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:41.329621 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-060bc208-2609-4f5a-8168-5b82d36c0b9f req-30745c4f-da23-4d1e-bb2d-11c93ba01c5d service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:41.330617 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-060bc208-2609-4f5a-8168-5b82d36c0b9f req-30745c4f-da23-4d1e-bb2d-11c93ba01c5d service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:41.344411 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-060bc208-2609-4f5a-8168-5b82d36c0b9f req-30745c4f-da23-4d1e-bb2d-11c93ba01c5d service nova] Creating event network-changed:acd2f1ab-4dd9-492b-8a9b-447c531381e8 for instance 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 on hv-cinder-84159 May 13 13:34:41.350010 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-060bc208-2609-4f5a-8168-5b82d36c0b9f req-30745c4f-da23-4d1e-bb2d-11c93ba01c5d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035890 May 13 13:34:41.351080 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 514/1053] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:34:41.890840 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-52ab5687-8169-410d-a8c5-7687237b760b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:41.891452 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-52ab5687-8169-410d-a8c5-7687237b760b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:41.899092 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-52ab5687-8169-410d-a8c5-7687237b760b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:41.899832 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-52ab5687-8169-410d-a8c5-7687237b760b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:41.900790 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-52ab5687-8169-410d-a8c5-7687237b760b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:41.901278 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-52ab5687-8169-410d-a8c5-7687237b760b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:42.033223 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-52ab5687-8169-410d-a8c5-7687237b760b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:42.041575 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-52ab5687-8169-410d-a8c5-7687237b760b tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1266 microversion: 2.1 time: 0.154625 May 13 13:34:42.042217 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 540/1054] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:41 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:42.368983 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-0e500f2a-29d9-4d07-aba7-48f46516a528 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92958d82-80a1-447c-8c26-8e2af8acf66c"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:42.370751 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-0e500f2a-29d9-4d07-aba7-48f46516a528 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:42.377221 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0e500f2a-29d9-4d07-aba7-48f46516a528 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:42.377683 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0e500f2a-29d9-4d07-aba7-48f46516a528 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:42.378497 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0e500f2a-29d9-4d07-aba7-48f46516a528 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:42.378966 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-0e500f2a-29d9-4d07-aba7-48f46516a528 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:43.058465 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-4edc6a84-8f55-4ae8-89c9-1b0c504be7b5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:43.059103 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-4edc6a84-8f55-4ae8-89c9-1b0c504be7b5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:43.065307 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4edc6a84-8f55-4ae8-89c9-1b0c504be7b5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:43.065753 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4edc6a84-8f55-4ae8-89c9-1b0c504be7b5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:43.066541 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4edc6a84-8f55-4ae8-89c9-1b0c504be7b5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:43.066977 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-4edc6a84-8f55-4ae8-89c9-1b0c504be7b5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:43.197987 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-4edc6a84-8f55-4ae8-89c9-1b0c504be7b5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:43.198355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-0e500f2a-29d9-4d07-aba7-48f46516a528 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833980 May 13 13:34:43.198976 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 515/1055] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:34:42 2022] POST /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:34:43.205660 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-4edc6a84-8f55-4ae8-89c9-1b0c504be7b5 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1266 microversion: 2.1 time: 0.150941 May 13 13:34:43.206267 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 541/1056] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:43 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:44.223242 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-fdc72709-ae10-4728-9517-c7ce4b7a9cc9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:44.223984 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-fdc72709-ae10-4728-9517-c7ce4b7a9cc9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:44.230950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fdc72709-ae10-4728-9517-c7ce4b7a9cc9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:44.231410 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fdc72709-ae10-4728-9517-c7ce4b7a9cc9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:44.232192 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fdc72709-ae10-4728-9517-c7ce4b7a9cc9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:44.232631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fdc72709-ae10-4728-9517-c7ce4b7a9cc9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:44.366169 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-fdc72709-ae10-4728-9517-c7ce4b7a9cc9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:44.373401 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-fdc72709-ae10-4728-9517-c7ce4b7a9cc9 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1266 microversion: 2.1 time: 0.154822 May 13 13:34:44.373989 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 516/1057] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:44 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:45.389902 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f36b1622-b4cb-4398-bf1d-80ce444b096d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:45.390527 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f36b1622-b4cb-4398-bf1d-80ce444b096d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:45.396901 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f36b1622-b4cb-4398-bf1d-80ce444b096d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:45.397359 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f36b1622-b4cb-4398-bf1d-80ce444b096d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:45.398168 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f36b1622-b4cb-4398-bf1d-80ce444b096d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:45.398611 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f36b1622-b4cb-4398-bf1d-80ce444b096d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:45.526630 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f36b1622-b4cb-4398-bf1d-80ce444b096d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:45.533903 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f36b1622-b4cb-4398-bf1d-80ce444b096d tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1266 microversion: 2.1 time: 0.147864 May 13 13:34:45.534475 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 542/1058] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:45 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:46.550226 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d4a4aaf5-9bdb-4660-8e6c-b6bef5653514 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:46.550848 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d4a4aaf5-9bdb-4660-8e6c-b6bef5653514 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:46.557727 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d4a4aaf5-9bdb-4660-8e6c-b6bef5653514 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:46.558221 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d4a4aaf5-9bdb-4660-8e6c-b6bef5653514 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:46.559012 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d4a4aaf5-9bdb-4660-8e6c-b6bef5653514 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:46.559479 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d4a4aaf5-9bdb-4660-8e6c-b6bef5653514 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:46.686969 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d4a4aaf5-9bdb-4660-8e6c-b6bef5653514 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:46.694795 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d4a4aaf5-9bdb-4660-8e6c-b6bef5653514 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1266 microversion: 2.1 time: 0.148622 May 13 13:34:46.695361 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 517/1059] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:46 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:47.710965 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-e229961d-e9a1-4641-9137-238db4f30493 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:47.711505 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-e229961d-e9a1-4641-9137-238db4f30493 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:47.717975 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e229961d-e9a1-4641-9137-238db4f30493 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:47.718433 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e229961d-e9a1-4641-9137-238db4f30493 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:47.719208 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e229961d-e9a1-4641-9137-238db4f30493 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:47.719655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-e229961d-e9a1-4641-9137-238db4f30493 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:47.847537 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-e229961d-e9a1-4641-9137-238db4f30493 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:47.855511 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-e229961d-e9a1-4641-9137-238db4f30493 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1266 microversion: 2.1 time: 0.148718 May 13 13:34:47.861918 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 543/1060] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:47 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:48.872122 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-96e37f27-bfee-4250-8c4b-2059d5100bf8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:48.872730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-96e37f27-bfee-4250-8c4b-2059d5100bf8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:48.879143 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-96e37f27-bfee-4250-8c4b-2059d5100bf8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:48.879620 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-96e37f27-bfee-4250-8c4b-2059d5100bf8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:48.880960 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-96e37f27-bfee-4250-8c4b-2059d5100bf8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:48.881394 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-96e37f27-bfee-4250-8c4b-2059d5100bf8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:49.018638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-96e37f27-bfee-4250-8c4b-2059d5100bf8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:49.025956 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-96e37f27-bfee-4250-8c4b-2059d5100bf8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1266 microversion: 2.1 time: 0.157645 May 13 13:34:49.026525 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 518/1061] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:48 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:50.042360 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-240715c4-00bd-48ac-8364-8c48b7cc9083 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:50.043000 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-240715c4-00bd-48ac-8364-8c48b7cc9083 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:50.049310 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-240715c4-00bd-48ac-8364-8c48b7cc9083 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:50.049764 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-240715c4-00bd-48ac-8364-8c48b7cc9083 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:50.053421 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-240715c4-00bd-48ac-8364-8c48b7cc9083 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:50.053421 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-240715c4-00bd-48ac-8364-8c48b7cc9083 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:50.184231 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-240715c4-00bd-48ac-8364-8c48b7cc9083 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:50.191586 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-240715c4-00bd-48ac-8364-8c48b7cc9083 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1266 microversion: 2.1 time: 0.153006 May 13 13:34:50.192180 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 544/1062] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:50 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:50.672478 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-fa746a5a-e4bc-46a7-b9e8-7d3265428c93 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92958d82-80a1-447c-8c26-8e2af8acf66c"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:50.673544 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-fa746a5a-e4bc-46a7-b9e8-7d3265428c93 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:50.680354 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa746a5a-e4bc-46a7-b9e8-7d3265428c93 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:50.680801 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa746a5a-e4bc-46a7-b9e8-7d3265428c93 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:50.681561 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa746a5a-e4bc-46a7-b9e8-7d3265428c93 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:50.682032 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fa746a5a-e4bc-46a7-b9e8-7d3265428c93 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:50.759305 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-fa746a5a-e4bc-46a7-b9e8-7d3265428c93 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Invalid volume: volume 92958d82-80a1-447c-8c26-8e2af8acf66c is already attached to instances: 2e839d2a-15b4-48ad-a357-ad4a871f1818 May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-fa746a5a-e4bc-46a7-b9e8-7d3265428c93 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: POST /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments HTTP/1.1 May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 74 May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:34:50.764967 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:34:50.766684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:34:50.766684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:34:50.766684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:34:50.766684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:34:50.766684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:34:50.766684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:34:50.766684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:34:50.766684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:34:50.766684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:34:50.766684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: May 13 13:34:50.766684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {"volumeAttachment": {"volumeId": "92958d82-80a1-447c-8c26-8e2af8acf66c"}} May 13 13:34:50.766684 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Invalid volume: volume 92958d82-80a1-447c-8c26-8e2af8acf66c is already attached to instances: 2e839d2a-15b4-48ad-a357-ad4a871f1818 May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'server_id': '2e839d2a-15b4-48ad-a357-ad4a871f1818', 'body': {'volumeAttachment': {'volumeId': '92958d82-80a1-447c-8c26-8e2af8acf66c'}}} May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 92958d82-80a1-447c-8c26-8e2af8acf66c is already attached to instances: 2e839d2a-15b4-48ad-a357-ad4a871f1818 May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:34:50.767649 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 92958d82-80a1-447c-8c26-8e2af8acf66c is already attached to instances: 2e839d2a-15b4-48ad-a357-ad4a871f1818 May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:34:50.769292 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:34:50.771016 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:34:50.771016 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:34:50.771016 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:34:50.771016 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 92958d82-80a1-447c-8c26-8e2af8acf66c is already attached to instances: 2e839d2a-15b4-48ad-a357-ad4a871f1818 May 13 13:34:50.771016 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:34:50.771016 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-fa746a5a-e4bc-46a7-b9e8-7d3265428c93 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 400 to user: Invalid volume: volume 92958d82-80a1-447c-8c26-8e2af8acf66c is already attached to instances: 2e839d2a-15b4-48ad-a357-ad4a871f1818 {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:34:50.771016 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-fa746a5a-e4bc-46a7-b9e8-7d3265428c93 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093968 May 13 13:34:50.771016 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 519/1063] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:34:50 2022] POST /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 13:34:50.821450 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-52a3860a-1298-4631-8669-4c456caef003 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:50.821970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-52a3860a-1298-4631-8669-4c456caef003 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:50.828031 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-52a3860a-1298-4631-8669-4c456caef003 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:50.828485 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-52a3860a-1298-4631-8669-4c456caef003 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:50.829249 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-52a3860a-1298-4631-8669-4c456caef003 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:50.829694 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-52a3860a-1298-4631-8669-4c456caef003 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:50.907673 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-52a3860a-1298-4631-8669-4c456caef003 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lazy-loading 'services' on Instance uuid 2e839d2a-15b4-48ad-a357-ad4a871f1818 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:34:51.104231 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-52a3860a-1298-4631-8669-4c456caef003 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments/92958d82-80a1-447c-8c26-8e2af8acf66c" status: 202 len: 0 microversion: 2.1 time: 0.286555 May 13 13:34:51.105211 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 545/1064] 10.222.0.25 () {58 vars in 1415 bytes} [Fri May 13 13:34:50 2022] DELETE /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments/92958d82-80a1-447c-8c26-8e2af8acf66c => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:34:51.113089 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-66d8d0f9-9c82-43a6-9fd0-108632a75bda tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:51.114308 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-66d8d0f9-9c82-43a6-9fd0-108632a75bda tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:51.120195 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-66d8d0f9-9c82-43a6-9fd0-108632a75bda tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:51.120645 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-66d8d0f9-9c82-43a6-9fd0-108632a75bda tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:51.121421 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-66d8d0f9-9c82-43a6-9fd0-108632a75bda tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:51.121884 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-66d8d0f9-9c82-43a6-9fd0-108632a75bda tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:51.151477 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-66d8d0f9-9c82-43a6-9fd0-108632a75bda tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042283 May 13 13:34:51.152039 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 520/1065] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:34:51 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:34:51.210855 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-f9a9bc88-259b-42a3-a613-c95ca2821fd7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:51.213874 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-f9a9bc88-259b-42a3-a613-c95ca2821fd7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:51.218734 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9a9bc88-259b-42a3-a613-c95ca2821fd7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:51.219273 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9a9bc88-259b-42a3-a613-c95ca2821fd7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:51.220150 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9a9bc88-259b-42a3-a613-c95ca2821fd7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:51.220387 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-2b77959c-c095-40b3-8000-cb4984b58657 req-97b433a3-f20b-42e7-9c16-ea15b348a999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ec7b2f-151a-4074-9dd9-b7a7b0e45c12", "name": "network-vif-plugged", "status": "completed", "tag": "acd2f1ab-4dd9-492b-8a9b-447c531381e8"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:51.220799 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-f9a9bc88-259b-42a3-a613-c95ca2821fd7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:51.236843 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-2b77959c-c095-40b3-8000-cb4984b58657 req-97b433a3-f20b-42e7-9c16-ea15b348a999 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:51.237309 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-2b77959c-c095-40b3-8000-cb4984b58657 req-97b433a3-f20b-42e7-9c16-ea15b348a999 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:51.249445 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-2b77959c-c095-40b3-8000-cb4984b58657 req-97b433a3-f20b-42e7-9c16-ea15b348a999 service nova] Creating event network-vif-plugged:acd2f1ab-4dd9-492b-8a9b-447c531381e8 for instance 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 on hv-cinder-84159 May 13 13:34:51.254535 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-2b77959c-c095-40b3-8000-cb4984b58657 req-97b433a3-f20b-42e7-9c16-ea15b348a999 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037739 May 13 13:34:51.259883 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 521/1066] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:34:51.354682 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-f9a9bc88-259b-42a3-a613-c95ca2821fd7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:51.362117 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-f9a9bc88-259b-42a3-a613-c95ca2821fd7 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1266 microversion: 2.1 time: 0.157039 May 13 13:34:51.362696 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 546/1067] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:51 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:52.164753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1e1510a5-1845-4a70-a785-cd8bba1a7cab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:52.165773 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1e1510a5-1845-4a70-a785-cd8bba1a7cab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:52.171968 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1e1510a5-1845-4a70-a785-cd8bba1a7cab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:52.175050 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1e1510a5-1845-4a70-a785-cd8bba1a7cab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:52.175050 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1e1510a5-1845-4a70-a785-cd8bba1a7cab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:52.175050 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1e1510a5-1845-4a70-a785-cd8bba1a7cab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:52.202331 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1e1510a5-1845-4a70-a785-cd8bba1a7cab tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042852 May 13 13:34:52.206387 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 522/1068] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:34:52 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:34:52.386113 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-48292236-1ce8-475d-8866-5562ad5071ad tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:52.386641 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-48292236-1ce8-475d-8866-5562ad5071ad tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:52.393144 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48292236-1ce8-475d-8866-5562ad5071ad tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:52.393606 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48292236-1ce8-475d-8866-5562ad5071ad tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:52.394437 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48292236-1ce8-475d-8866-5562ad5071ad tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:52.394883 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-48292236-1ce8-475d-8866-5562ad5071ad tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:52.528054 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-48292236-1ce8-475d-8866-5562ad5071ad tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:52.535384 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-48292236-1ce8-475d-8866-5562ad5071ad tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1266 microversion: 2.1 time: 0.160307 May 13 13:34:52.535971 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 547/1069] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:52 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:53.214792 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-26290429-f0c5-4483-b62b-65341d72f871 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:53.215714 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-26290429-f0c5-4483-b62b-65341d72f871 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:53.222123 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-26290429-f0c5-4483-b62b-65341d72f871 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:53.222572 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-26290429-f0c5-4483-b62b-65341d72f871 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:53.223345 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-26290429-f0c5-4483-b62b-65341d72f871 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:53.223783 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-26290429-f0c5-4483-b62b-65341d72f871 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:53.252181 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-26290429-f0c5-4483-b62b-65341d72f871 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041336 May 13 13:34:53.252732 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 523/1070] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:34:53 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:34:53.307497 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-828180f8-b78b-4f6f-a5ba-b486a229f189 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:53.308142 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-828180f8-b78b-4f6f-a5ba-b486a229f189 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:53.314488 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-828180f8-b78b-4f6f-a5ba-b486a229f189 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:53.315082 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-828180f8-b78b-4f6f-a5ba-b486a229f189 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:53.315969 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-828180f8-b78b-4f6f-a5ba-b486a229f189 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:53.316519 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-828180f8-b78b-4f6f-a5ba-b486a229f189 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:53.341437 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-828180f8-b78b-4f6f-a5ba-b486a229f189 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:34:53.554079 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-62d27131-49b5-4587-a6cb-6a05a40f4e6c tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:53.554758 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-62d27131-49b5-4587-a6cb-6a05a40f4e6c tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:53.561537 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-62d27131-49b5-4587-a6cb-6a05a40f4e6c tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:53.562120 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-62d27131-49b5-4587-a6cb-6a05a40f4e6c tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:53.563013 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-62d27131-49b5-4587-a6cb-6a05a40f4e6c tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:53.563450 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-62d27131-49b5-4587-a6cb-6a05a40f4e6c tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:53.699617 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-62d27131-49b5-4587-a6cb-6a05a40f4e6c tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:53.707060 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-62d27131-49b5-4587-a6cb-6a05a40f4e6c tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1453 microversion: 2.1 time: 0.158068 May 13 13:34:53.707670 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 524/1071] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:53 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:34:53.722706 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d39b3eb8-bbcc-4664-89a2-b7e1711ad1df tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:53.723313 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d39b3eb8-bbcc-4664-89a2-b7e1711ad1df tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:53.730613 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d39b3eb8-bbcc-4664-89a2-b7e1711ad1df tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:53.730613 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d39b3eb8-bbcc-4664-89a2-b7e1711ad1df tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:53.730965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d39b3eb8-bbcc-4664-89a2-b7e1711ad1df tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:53.731193 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d39b3eb8-bbcc-4664-89a2-b7e1711ad1df tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:53.778266 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-828180f8-b78b-4f6f-a5ba-b486a229f189 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 204 len: 0 microversion: 2.1 time: 0.474276 May 13 13:34:53.778890 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 548/1072] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:34:53 2022] DELETE /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:34:53.788262 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c472aafe-c4f9-4a52-b2bc-0495c75845ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:53.788967 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c472aafe-c4f9-4a52-b2bc-0495c75845ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:53.795022 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c472aafe-c4f9-4a52-b2bc-0495c75845ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:53.795476 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c472aafe-c4f9-4a52-b2bc-0495c75845ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:53.796300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c472aafe-c4f9-4a52-b2bc-0495c75845ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:53.796747 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c472aafe-c4f9-4a52-b2bc-0495c75845ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:53.869227 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d39b3eb8-bbcc-4664-89a2-b7e1711ad1df tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:53.876676 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d39b3eb8-bbcc-4664-89a2-b7e1711ad1df tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1453 microversion: 2.1 time: 0.157456 May 13 13:34:53.877251 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 525/1073] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:53 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:34:53.932858 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c472aafe-c4f9-4a52-b2bc-0495c75845ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:53.940314 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c472aafe-c4f9-4a52-b2bc-0495c75845ff tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1680 microversion: 2.1 time: 0.156972 May 13 13:34:53.940921 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 549/1074] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:53 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:34:54.957715 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-170fc0c6-2517-40b0-99c0-9c821ae9e55a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:54.958966 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-170fc0c6-2517-40b0-99c0-9c821ae9e55a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:54.965942 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-170fc0c6-2517-40b0-99c0-9c821ae9e55a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:54.966635 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-170fc0c6-2517-40b0-99c0-9c821ae9e55a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:54.967606 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-170fc0c6-2517-40b0-99c0-9c821ae9e55a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:54.968055 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-170fc0c6-2517-40b0-99c0-9c821ae9e55a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:55.167142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-170fc0c6-2517-40b0-99c0-9c821ae9e55a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:55.174775 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-170fc0c6-2517-40b0-99c0-9c821ae9e55a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1680 microversion: 2.1 time: 0.220999 May 13 13:34:55.175348 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 526/1075] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:54 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:56.191863 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-6bdf2747-bf45-4f46-a1b9-ff0d30a9b497 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:56.192465 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-6bdf2747-bf45-4f46-a1b9-ff0d30a9b497 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:56.198779 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6bdf2747-bf45-4f46-a1b9-ff0d30a9b497 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:56.199230 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6bdf2747-bf45-4f46-a1b9-ff0d30a9b497 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:56.200022 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6bdf2747-bf45-4f46-a1b9-ff0d30a9b497 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:56.200463 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-6bdf2747-bf45-4f46-a1b9-ff0d30a9b497 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:56.342278 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-6bdf2747-bf45-4f46-a1b9-ff0d30a9b497 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:56.347312 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-6bdf2747-bf45-4f46-a1b9-ff0d30a9b497 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1680 microversion: 2.1 time: 0.159399 May 13 13:34:56.347947 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 550/1076] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:56 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:56.801632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-24e13d6e-b865-4f58-9af3-a2fd83c61bed req-e2e7546a-35c8-4a57-9974-91cf03c7652a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ec7b2f-151a-4074-9dd9-b7a7b0e45c12", "tag": "acd2f1ab-4dd9-492b-8a9b-447c531381e8"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:56.810730 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-24e13d6e-b865-4f58-9af3-a2fd83c61bed req-e2e7546a-35c8-4a57-9974-91cf03c7652a service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:56.811263 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-24e13d6e-b865-4f58-9af3-a2fd83c61bed req-e2e7546a-35c8-4a57-9974-91cf03c7652a service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:56.823281 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-24e13d6e-b865-4f58-9af3-a2fd83c61bed req-e2e7546a-35c8-4a57-9974-91cf03c7652a service nova] Creating event network-changed:acd2f1ab-4dd9-492b-8a9b-447c531381e8 for instance 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 on hv-cinder-84159 May 13 13:34:56.828336 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-24e13d6e-b865-4f58-9af3-a2fd83c61bed req-e2e7546a-35c8-4a57-9974-91cf03c7652a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030791 May 13 13:34:56.829312 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 527/1077] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:34:57.369243 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-779af638-4c36-4899-9119-e7f2f41fd14a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:57.370767 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-779af638-4c36-4899-9119-e7f2f41fd14a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:57.387578 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-779af638-4c36-4899-9119-e7f2f41fd14a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:57.388393 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-779af638-4c36-4899-9119-e7f2f41fd14a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:57.389401 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-779af638-4c36-4899-9119-e7f2f41fd14a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:57.390228 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-779af638-4c36-4899-9119-e7f2f41fd14a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:57.458738 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-779af638-4c36-4899-9119-e7f2f41fd14a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:57.459422 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-779af638-4c36-4899-9119-e7f2f41fd14a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:57.460327 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-779af638-4c36-4899-9119-e7f2f41fd14a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lazy-loading 'fault' on Instance uuid 2e839d2a-15b4-48ad-a357-ad4a871f1818 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:34:57.516573 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-779af638-4c36-4899-9119-e7f2f41fd14a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:34:57.525820 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-779af638-4c36-4899-9119-e7f2f41fd14a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 200 len: 1330 microversion: 2.1 time: 0.164424 May 13 13:34:57.533335 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 551/1078] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:57 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 1330 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:34:58.542865 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7bcda34e-542b-45b6-a7e9-26a94a5d8c3f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:58.543599 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7bcda34e-542b-45b6-a7e9-26a94a5d8c3f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:34:58.550077 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7bcda34e-542b-45b6-a7e9-26a94a5d8c3f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:58.550544 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7bcda34e-542b-45b6-a7e9-26a94a5d8c3f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:58.551296 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7bcda34e-542b-45b6-a7e9-26a94a5d8c3f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:58.552213 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7bcda34e-542b-45b6-a7e9-26a94a5d8c3f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:58.564997 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-7bcda34e-542b-45b6-a7e9-26a94a5d8c3f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7bcda34e-542b-45b6-a7e9-26a94a5d8c3f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 HTTP/1.1 May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:34:58.566638 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:34:58.569807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:34:58.569807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:34:58.569807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:34:58.569807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:34:58.569807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:34:58.569807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:34:58.569807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:34:58.569807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:34:58.569807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:34:58.569807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:34:58.569807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:34:58.569807 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '2e839d2a-15b4-48ad-a357-ad4a871f1818'} May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:34:58.571236 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:34:58.573750 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:34:58.575864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7bcda34e-542b-45b6-a7e9-26a94a5d8c3f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 404 to user: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:34:58.575864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7bcda34e-542b-45b6-a7e9-26a94a5d8c3f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 404 len: 111 microversion: 2.1 time: 0.029447 May 13 13:34:58.575864 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 528/1079] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:34:58 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:34:58.577099 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-d257e6bb-5cf6-4de5-a86a-77a03e11850c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '.version_select at 0x7faaa1c78430>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:34:58.659139 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-d257e6bb-5cf6-4de5-a86a-77a03e11850c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208460516" status: 202 len: 0 microversion: 2.1 time: 0.085677 May 13 13:34:58.660500 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 552/1080] 10.222.0.25 () {58 vars in 1217 bytes} [Fri May 13 13:34:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208460516 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:34:58.853929 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-19d5f8df-1ddf-4229-871b-3a2adcdf10f7 req-a868de76-d48f-4b32-9bd9-42854930fa7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e839d2a-15b4-48ad-a357-ad4a871f1818", "name": "network-vif-deleted", "tag": "d3fd9ca9-9f12-460c-bf10-dc86aa9b63ab"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:58.863308 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-19d5f8df-1ddf-4229-871b-3a2adcdf10f7 req-a868de76-d48f-4b32-9bd9-42854930fa7f service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:34:58.863308 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-19d5f8df-1ddf-4229-871b-3a2adcdf10f7 req-a868de76-d48f-4b32-9bd9-42854930fa7f service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:34:58.875923 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-19d5f8df-1ddf-4229-871b-3a2adcdf10f7 req-a868de76-d48f-4b32-9bd9-42854930fa7f service nova] Creating event network-vif-deleted:d3fd9ca9-9f12-460c-bf10-dc86aa9b63ab for instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 on hv-cinder-84159 May 13 13:34:58.880715 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-19d5f8df-1ddf-4229-871b-3a2adcdf10f7 req-a868de76-d48f-4b32-9bd9-42854930fa7f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030488 May 13 13:34:58.881313 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 529/1081] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:34:59.405758 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7de6c195-4b0b-4275-9024-f4f419ed9e36 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: .version_select at 0x7faaa1c3c310>, body: {"keypair": {"name": "tempest-keypair-687142636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/3TABzUo5rSNG5PYaqhwOTWuvdvrhBpFHvNH0RBvBSsVOINsB72ZrbtEWBIB/wef/mXF1B4Xn0AkjO6qh80F955t9KqgTwsvc9ieGULxOqk+kD+kKesJZ6UVchmKYDVA=="}} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:34:59.420231 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-7de6c195-4b0b-4275-9024-f4f419ed9e36 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for project 1e72f39546704606927bcefdc0f13235. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:34:59.424291 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.quota [None req-7de6c195-4b0b-4275-9024-f4f419ed9e36 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for user 79dbde2a65224927af4bb5e77090496c and project 1e72f39546704606927bcefdc0f13235. Resources: {'key_pairs'} {{(pid=117603) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:34:59.555695 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7de6c195-4b0b-4275-9024-f4f419ed9e36 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.153739 May 13 13:34:59.556235 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 553/1082] 10.222.0.25 () {60 vars in 1158 bytes} [Fri May 13 13:34:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:35:01.112108 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7fd7eb2d-7db1-401d-ac33-f98fd3f4903b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:35:01.112933 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7fd7eb2d-7db1-401d-ac33-f98fd3f4903b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:01.119261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7fd7eb2d-7db1-401d-ac33-f98fd3f4903b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:01.119819 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7fd7eb2d-7db1-401d-ac33-f98fd3f4903b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:01.120657 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7fd7eb2d-7db1-401d-ac33-f98fd3f4903b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:01.121098 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7fd7eb2d-7db1-401d-ac33-f98fd3f4903b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:01.144381 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-7fd7eb2d-7db1-401d-ac33-f98fd3f4903b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lazy-loading 'flavor' on Instance uuid b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:35:01.374306 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7fd7eb2d-7db1-401d-ac33-f98fd3f4903b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "POST /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69/action" status: 202 len: 0 microversion: 2.1 time: 0.266663 May 13 13:35:01.374876 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 530/1083] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:35:01 2022] POST /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:35:01.384259 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-239dedc1-6836-4b20-be0d-7b6f65c6c68b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:01.385211 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-239dedc1-6836-4b20-be0d-7b6f65c6c68b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:01.391913 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-239dedc1-6836-4b20-be0d-7b6f65c6c68b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:01.394957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-239dedc1-6836-4b20-be0d-7b6f65c6c68b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:01.394957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-239dedc1-6836-4b20-be0d-7b6f65c6c68b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:01.394957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-239dedc1-6836-4b20-be0d-7b6f65c6c68b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:01.548424 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-239dedc1-6836-4b20-be0d-7b6f65c6c68b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:01.556935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-239dedc1-6836-4b20-be0d-7b6f65c6c68b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.177634 May 13 13:35:01.557630 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 554/1084] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:01 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:01.744600 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1194107484", "imageRef": "be02aac1-6baa-4538-9717-ad440c9cac6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46cd8800-6675-4b3d-a84e-b42f58021a8c"}], "security_groups": [{"name": "tempest-securitygroup--1788319783"}], "key_name": "tempest-keypair-687142636", "user_data": "}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:35:01.846417 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.network.neutron [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] validate_networks() for [('46cd8800-6675-4b3d-a84e-b42f58021a8c', None, None, None, None, None)] {{(pid=117602) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:35:02.210845 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Flavor limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:35:02.211463 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Image limits 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:35:02.211775 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Flavor pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:35:02.212192 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Image pref 0:0:0 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:35:02.212613 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.virt.hardware [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117602) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:35:02.221227 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:02.221837 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:02.222660 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:02.223105 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:02.239633 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for project 1e72f39546704606927bcefdc0f13235. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:35:02.243527 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.quota [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Getting quotas for user 79dbde2a65224927af4bb5e77090496c and project 1e72f39546704606927bcefdc0f13235. Resources: {'instances', 'cores', 'ram'} {{(pid=117602) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:35:02.254245 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Going to run 1 instances... {{(pid=117602) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:35:02.257161 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be02aac1-6baa-4538-9717-ad440c9cac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117602) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:35:02.356455 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ca964df3-3ef8-4d97-a95a-322ea757ac40 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.617028 May 13 13:35:02.357108 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 531/1085] 10.222.0.25 () {60 vars in 1146 bytes} [Fri May 13 13:35:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:35:02.367697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-04cd0709-4873-41fb-99d5-b8c1709eaadb tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:02.368321 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-04cd0709-4873-41fb-99d5-b8c1709eaadb tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:02.421028 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-04cd0709-4873-41fb-99d5-b8c1709eaadb tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:02.428052 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-04cd0709-4873-41fb-99d5-b8c1709eaadb tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1241 microversion: 2.1 time: 0.064836 May 13 13:35:02.428624 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 555/1086] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:02 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:02.574447 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-309c2c50-34f6-4563-9b0b-a8b8fa8f4085 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:02.575066 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-309c2c50-34f6-4563-9b0b-a8b8fa8f4085 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:02.581306 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-309c2c50-34f6-4563-9b0b-a8b8fa8f4085 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:02.581759 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-309c2c50-34f6-4563-9b0b-a8b8fa8f4085 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:02.582555 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-309c2c50-34f6-4563-9b0b-a8b8fa8f4085 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:02.583026 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-309c2c50-34f6-4563-9b0b-a8b8fa8f4085 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:02.714412 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-309c2c50-34f6-4563-9b0b-a8b8fa8f4085 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:02.721771 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-309c2c50-34f6-4563-9b0b-a8b8fa8f4085 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.151191 May 13 13:35:02.722356 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 532/1087] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:02 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:03.445556 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c130ee69-3fb5-444d-a973-35dc234f2401 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:03.446146 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c130ee69-3fb5-444d-a973-35dc234f2401 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:03.453129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c130ee69-3fb5-444d-a973-35dc234f2401 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:03.453605 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c130ee69-3fb5-444d-a973-35dc234f2401 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:03.454411 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c130ee69-3fb5-444d-a973-35dc234f2401 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:03.454850 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c130ee69-3fb5-444d-a973-35dc234f2401 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:03.516194 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-c130ee69-3fb5-444d-a973-35dc234f2401 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:03.524682 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c130ee69-3fb5-444d-a973-35dc234f2401 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1245 microversion: 2.1 time: 0.083057 May 13 13:35:03.525489 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 556/1088] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:03 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:03.738962 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-052dd87e-ec9f-4ca3-8748-190bbb6f5ac6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:03.740180 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-052dd87e-ec9f-4ca3-8748-190bbb6f5ac6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:03.746641 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-052dd87e-ec9f-4ca3-8748-190bbb6f5ac6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:03.747118 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-052dd87e-ec9f-4ca3-8748-190bbb6f5ac6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:03.747881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-052dd87e-ec9f-4ca3-8748-190bbb6f5ac6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:03.748328 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-052dd87e-ec9f-4ca3-8748-190bbb6f5ac6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:03.885856 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-052dd87e-ec9f-4ca3-8748-190bbb6f5ac6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:03.893469 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-052dd87e-ec9f-4ca3-8748-190bbb6f5ac6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.158422 May 13 13:35:03.894053 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 533/1089] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:03 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:04.542273 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-710a9817-f52c-4576-8449-c8b3c428f24d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:04.542894 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-710a9817-f52c-4576-8449-c8b3c428f24d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:04.549334 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-710a9817-f52c-4576-8449-c8b3c428f24d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:04.551649 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-710a9817-f52c-4576-8449-c8b3c428f24d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:04.551649 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-710a9817-f52c-4576-8449-c8b3c428f24d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:04.551649 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-710a9817-f52c-4576-8449-c8b3c428f24d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:04.613710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-710a9817-f52c-4576-8449-c8b3c428f24d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:04.621304 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-710a9817-f52c-4576-8449-c8b3c428f24d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1311 microversion: 2.1 time: 0.082937 May 13 13:35:04.621883 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 557/1090] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:04 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:04.910957 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-667ac940-98c7-4cfc-a8dc-11fb3c8fce6a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:04.912107 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-667ac940-98c7-4cfc-a8dc-11fb3c8fce6a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:04.918451 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-667ac940-98c7-4cfc-a8dc-11fb3c8fce6a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:04.919021 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-667ac940-98c7-4cfc-a8dc-11fb3c8fce6a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:04.919828 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-667ac940-98c7-4cfc-a8dc-11fb3c8fce6a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:04.920275 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-667ac940-98c7-4cfc-a8dc-11fb3c8fce6a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:05.052980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-667ac940-98c7-4cfc-a8dc-11fb3c8fce6a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:05.060996 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-667ac940-98c7-4cfc-a8dc-11fb3c8fce6a tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.153832 May 13 13:35:05.071043 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 534/1091] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:04 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:05.639047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2dabf38a-1b76-4a35-a4ea-5b19ad4cdd9f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:05.640807 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2dabf38a-1b76-4a35-a4ea-5b19ad4cdd9f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:05.647945 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2dabf38a-1b76-4a35-a4ea-5b19ad4cdd9f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:05.648403 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2dabf38a-1b76-4a35-a4ea-5b19ad4cdd9f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:05.649198 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2dabf38a-1b76-4a35-a4ea-5b19ad4cdd9f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:05.649639 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2dabf38a-1b76-4a35-a4ea-5b19ad4cdd9f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:05.863310 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2dabf38a-1b76-4a35-a4ea-5b19ad4cdd9f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:05.871256 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2dabf38a-1b76-4a35-a4ea-5b19ad4cdd9f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1367 microversion: 2.1 time: 0.236045 May 13 13:35:05.871872 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 558/1092] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:05 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:06.014496 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-f3e143c4-ecad-43a8-b94b-4ccb2f574787 req-5eabed09-3b8b-4c6b-80e0-253823e03cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a314ae-726d-40d4-93d6-285e27a79564", "tag": "814f959d-cd9e-4950-a1f5-50171380b066"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:35:06.023591 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-f3e143c4-ecad-43a8-b94b-4ccb2f574787 req-5eabed09-3b8b-4c6b-80e0-253823e03cc6 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:06.024044 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-f3e143c4-ecad-43a8-b94b-4ccb2f574787 req-5eabed09-3b8b-4c6b-80e0-253823e03cc6 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:06.035556 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-f3e143c4-ecad-43a8-b94b-4ccb2f574787 req-5eabed09-3b8b-4c6b-80e0-253823e03cc6 service nova] Creating event network-changed:814f959d-cd9e-4950-a1f5-50171380b066 for instance 80a314ae-726d-40d4-93d6-285e27a79564 on hv-cinder-84159 May 13 13:35:06.040587 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-f3e143c4-ecad-43a8-b94b-4ccb2f574787 req-5eabed09-3b8b-4c6b-80e0-253823e03cc6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029774 May 13 13:35:06.041458 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 535/1093] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:35:06.078435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5b703bc3-a795-4174-bfd1-aa80c6d5dee8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:06.079357 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5b703bc3-a795-4174-bfd1-aa80c6d5dee8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:06.086122 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5b703bc3-a795-4174-bfd1-aa80c6d5dee8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:06.086578 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5b703bc3-a795-4174-bfd1-aa80c6d5dee8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:06.087560 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5b703bc3-a795-4174-bfd1-aa80c6d5dee8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:06.088201 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5b703bc3-a795-4174-bfd1-aa80c6d5dee8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:06.340295 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-5b703bc3-a795-4174-bfd1-aa80c6d5dee8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:06.347605 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5b703bc3-a795-4174-bfd1-aa80c6d5dee8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.273192 May 13 13:35:06.348188 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 559/1094] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:06 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:06.889013 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ce85e5bf-6794-48a6-b4d9-a63871466cf9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:06.889632 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ce85e5bf-6794-48a6-b4d9-a63871466cf9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:06.896347 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ce85e5bf-6794-48a6-b4d9-a63871466cf9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:06.896805 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ce85e5bf-6794-48a6-b4d9-a63871466cf9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:06.897580 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ce85e5bf-6794-48a6-b4d9-a63871466cf9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:06.898052 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ce85e5bf-6794-48a6-b4d9-a63871466cf9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:07.031020 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ce85e5bf-6794-48a6-b4d9-a63871466cf9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:07.038881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ce85e5bf-6794-48a6-b4d9-a63871466cf9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1367 microversion: 2.1 time: 0.154192 May 13 13:35:07.039448 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 536/1095] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:06 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:07.364427 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9d6dfc7c-ba73-4f58-97e3-81295d00cd55 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:07.365040 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9d6dfc7c-ba73-4f58-97e3-81295d00cd55 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:07.371335 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d6dfc7c-ba73-4f58-97e3-81295d00cd55 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:07.371789 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d6dfc7c-ba73-4f58-97e3-81295d00cd55 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:07.372557 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d6dfc7c-ba73-4f58-97e3-81295d00cd55 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:07.372997 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d6dfc7c-ba73-4f58-97e3-81295d00cd55 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:07.505023 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9d6dfc7c-ba73-4f58-97e3-81295d00cd55 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:07.512944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9d6dfc7c-ba73-4f58-97e3-81295d00cd55 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.152420 May 13 13:35:07.513976 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 560/1096] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:07 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:08.055351 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-361e4304-a790-4227-a5cd-2e1461721770 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:08.055964 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-361e4304-a790-4227-a5cd-2e1461721770 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:08.062261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-361e4304-a790-4227-a5cd-2e1461721770 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:08.062716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-361e4304-a790-4227-a5cd-2e1461721770 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:08.063487 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-361e4304-a790-4227-a5cd-2e1461721770 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:08.063929 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-361e4304-a790-4227-a5cd-2e1461721770 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:08.188519 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-361e4304-a790-4227-a5cd-2e1461721770 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:08.195771 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-361e4304-a790-4227-a5cd-2e1461721770 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1367 microversion: 2.1 time: 0.144789 May 13 13:35:08.196279 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 537/1097] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:08 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:08.530316 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a47f1327-fb6a-46f3-aa9d-1ebce4831935 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:08.530941 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a47f1327-fb6a-46f3-aa9d-1ebce4831935 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:08.537453 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a47f1327-fb6a-46f3-aa9d-1ebce4831935 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:08.537955 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a47f1327-fb6a-46f3-aa9d-1ebce4831935 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:08.538733 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a47f1327-fb6a-46f3-aa9d-1ebce4831935 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:08.539182 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a47f1327-fb6a-46f3-aa9d-1ebce4831935 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:08.666120 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a47f1327-fb6a-46f3-aa9d-1ebce4831935 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:08.673379 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a47f1327-fb6a-46f3-aa9d-1ebce4831935 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.147006 May 13 13:35:08.673980 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 561/1098] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:08 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:09.213683 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ff15b6b7-e85c-4feb-9bc1-e312a69a03fe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:09.214282 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ff15b6b7-e85c-4feb-9bc1-e312a69a03fe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:09.220516 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ff15b6b7-e85c-4feb-9bc1-e312a69a03fe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:09.220963 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ff15b6b7-e85c-4feb-9bc1-e312a69a03fe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:09.221740 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ff15b6b7-e85c-4feb-9bc1-e312a69a03fe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:09.222202 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ff15b6b7-e85c-4feb-9bc1-e312a69a03fe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:09.351628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ff15b6b7-e85c-4feb-9bc1-e312a69a03fe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:09.359044 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ff15b6b7-e85c-4feb-9bc1-e312a69a03fe tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1367 microversion: 2.1 time: 0.150360 May 13 13:35:09.359626 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 538/1099] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:09 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:09.690266 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-912ea335-4cc4-4f26-83ee-3bdeb823ddc8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:09.690860 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-912ea335-4cc4-4f26-83ee-3bdeb823ddc8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:09.697708 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-912ea335-4cc4-4f26-83ee-3bdeb823ddc8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:09.698187 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-912ea335-4cc4-4f26-83ee-3bdeb823ddc8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:09.698962 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-912ea335-4cc4-4f26-83ee-3bdeb823ddc8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:09.699411 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-912ea335-4cc4-4f26-83ee-3bdeb823ddc8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:09.831063 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-912ea335-4cc4-4f26-83ee-3bdeb823ddc8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:09.838692 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-912ea335-4cc4-4f26-83ee-3bdeb823ddc8 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.152326 May 13 13:35:09.839201 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 562/1100] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:09 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:10.375842 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e5fa0c36-c7d5-42d1-b40c-0c9bc681d488 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:10.376460 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e5fa0c36-c7d5-42d1-b40c-0c9bc681d488 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:10.382844 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e5fa0c36-c7d5-42d1-b40c-0c9bc681d488 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:10.383306 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e5fa0c36-c7d5-42d1-b40c-0c9bc681d488 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:10.384577 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e5fa0c36-c7d5-42d1-b40c-0c9bc681d488 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:10.385024 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e5fa0c36-c7d5-42d1-b40c-0c9bc681d488 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:10.512465 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e5fa0c36-c7d5-42d1-b40c-0c9bc681d488 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:10.519888 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e5fa0c36-c7d5-42d1-b40c-0c9bc681d488 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1367 microversion: 2.1 time: 0.147994 May 13 13:35:10.520459 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 539/1101] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:10 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:10.855730 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0e474458-2e79-4353-b133-6ef68929b13b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:10.856273 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0e474458-2e79-4353-b133-6ef68929b13b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:10.862600 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0e474458-2e79-4353-b133-6ef68929b13b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:10.863061 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0e474458-2e79-4353-b133-6ef68929b13b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:10.863834 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0e474458-2e79-4353-b133-6ef68929b13b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:10.864280 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0e474458-2e79-4353-b133-6ef68929b13b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:10.991609 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0e474458-2e79-4353-b133-6ef68929b13b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:10.999426 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0e474458-2e79-4353-b133-6ef68929b13b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.147808 May 13 13:35:11.000008 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 563/1102] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:10 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:11.287922 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-360d582b-0f02-4d57-9532-6e32e2aa86aa req-9f5e8f00-71e1-4079-b60e-b9e6d48a6467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a314ae-726d-40d4-93d6-285e27a79564", "name": "network-vif-plugged", "status": "completed", "tag": "814f959d-cd9e-4950-a1f5-50171380b066"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:35:11.296248 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-360d582b-0f02-4d57-9532-6e32e2aa86aa req-9f5e8f00-71e1-4079-b60e-b9e6d48a6467 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:11.296695 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-360d582b-0f02-4d57-9532-6e32e2aa86aa req-9f5e8f00-71e1-4079-b60e-b9e6d48a6467 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:11.307871 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-360d582b-0f02-4d57-9532-6e32e2aa86aa req-9f5e8f00-71e1-4079-b60e-b9e6d48a6467 service nova] Creating event network-vif-plugged:814f959d-cd9e-4950-a1f5-50171380b066 for instance 80a314ae-726d-40d4-93d6-285e27a79564 on hv-cinder-84159 May 13 13:35:11.312914 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-360d582b-0f02-4d57-9532-6e32e2aa86aa req-9f5e8f00-71e1-4079-b60e-b9e6d48a6467 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028608 May 13 13:35:11.313505 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 540/1103] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:35:11.536316 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-b6c623eb-6b7b-414f-a259-39c15e2085c5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:11.536932 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-b6c623eb-6b7b-414f-a259-39c15e2085c5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:11.543419 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b6c623eb-6b7b-414f-a259-39c15e2085c5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:11.548212 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b6c623eb-6b7b-414f-a259-39c15e2085c5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:11.548212 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b6c623eb-6b7b-414f-a259-39c15e2085c5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:11.548212 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-b6c623eb-6b7b-414f-a259-39c15e2085c5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:11.683684 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-b6c623eb-6b7b-414f-a259-39c15e2085c5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:11.691406 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-b6c623eb-6b7b-414f-a259-39c15e2085c5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1367 microversion: 2.1 time: 0.158849 May 13 13:35:11.692699 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 564/1104] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:11 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:12.017541 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7bc0445a-a0ee-4a9f-8bce-cf3c33b0726e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:12.018199 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7bc0445a-a0ee-4a9f-8bce-cf3c33b0726e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:12.024170 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7bc0445a-a0ee-4a9f-8bce-cf3c33b0726e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:12.024636 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7bc0445a-a0ee-4a9f-8bce-cf3c33b0726e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:12.026035 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7bc0445a-a0ee-4a9f-8bce-cf3c33b0726e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:12.026484 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7bc0445a-a0ee-4a9f-8bce-cf3c33b0726e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:12.218409 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-7bc0445a-a0ee-4a9f-8bce-cf3c33b0726e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:12.225761 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7bc0445a-a0ee-4a9f-8bce-cf3c33b0726e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.213148 May 13 13:35:12.226382 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 541/1105] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:12 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:12.707889 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-44810199-92c1-4813-bb95-ef1e5518757d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:12.708537 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-44810199-92c1-4813-bb95-ef1e5518757d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:12.715027 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-44810199-92c1-4813-bb95-ef1e5518757d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:12.715477 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-44810199-92c1-4813-bb95-ef1e5518757d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:12.716242 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-44810199-92c1-4813-bb95-ef1e5518757d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:12.716681 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-44810199-92c1-4813-bb95-ef1e5518757d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:12.961494 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-44810199-92c1-4813-bb95-ef1e5518757d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:12.969225 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-44810199-92c1-4813-bb95-ef1e5518757d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1367 microversion: 2.1 time: 0.265172 May 13 13:35:12.973237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 565/1106] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:12 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:13.242974 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-aa7d4a0a-77c2-4e9a-ba41-436ccf631500 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:13.243601 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-aa7d4a0a-77c2-4e9a-ba41-436ccf631500 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:13.250200 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-aa7d4a0a-77c2-4e9a-ba41-436ccf631500 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:13.250652 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-aa7d4a0a-77c2-4e9a-ba41-436ccf631500 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:13.251429 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-aa7d4a0a-77c2-4e9a-ba41-436ccf631500 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:13.251870 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-aa7d4a0a-77c2-4e9a-ba41-436ccf631500 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:13.432355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-aa7d4a0a-77c2-4e9a-ba41-436ccf631500 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:13.439663 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-aa7d4a0a-77c2-4e9a-ba41-436ccf631500 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.200697 May 13 13:35:13.440229 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 542/1107] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:13 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:13.988398 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-36e5fa79-bb3b-4549-81bb-422595b13245 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:13.989010 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-36e5fa79-bb3b-4549-81bb-422595b13245 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:13.995765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-36e5fa79-bb3b-4549-81bb-422595b13245 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:13.996212 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-36e5fa79-bb3b-4549-81bb-422595b13245 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:13.996973 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-36e5fa79-bb3b-4549-81bb-422595b13245 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:13.997408 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-36e5fa79-bb3b-4549-81bb-422595b13245 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:14.131083 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-36e5fa79-bb3b-4549-81bb-422595b13245 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:14.138634 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-36e5fa79-bb3b-4549-81bb-422595b13245 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1367 microversion: 2.1 time: 0.154108 May 13 13:35:14.139214 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 566/1108] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:13 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:14.456516 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-3096d593-f08e-4c58-87fb-37bb617cbaac tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:14.457108 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-3096d593-f08e-4c58-87fb-37bb617cbaac tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:14.464271 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3096d593-f08e-4c58-87fb-37bb617cbaac tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:14.464756 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3096d593-f08e-4c58-87fb-37bb617cbaac tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:14.465541 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3096d593-f08e-4c58-87fb-37bb617cbaac tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:14.466015 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-3096d593-f08e-4c58-87fb-37bb617cbaac tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:14.601762 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-3096d593-f08e-4c58-87fb-37bb617cbaac tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:14.610290 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-3096d593-f08e-4c58-87fb-37bb617cbaac tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.157619 May 13 13:35:14.610880 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 543/1109] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:14 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:15.155857 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-0bf76ea9-372d-4dbc-a50f-36c425369a29 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:15.156454 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-0bf76ea9-372d-4dbc-a50f-36c425369a29 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:15.162712 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0bf76ea9-372d-4dbc-a50f-36c425369a29 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:15.163165 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0bf76ea9-372d-4dbc-a50f-36c425369a29 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:15.163937 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0bf76ea9-372d-4dbc-a50f-36c425369a29 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:15.164375 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-0bf76ea9-372d-4dbc-a50f-36c425369a29 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:15.448770 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-0bf76ea9-372d-4dbc-a50f-36c425369a29 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:15.456144 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-0bf76ea9-372d-4dbc-a50f-36c425369a29 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1557 microversion: 2.1 time: 0.304169 May 13 13:35:15.456705 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 567/1110] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:15 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1557 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:15.481415 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-050f5c61-37ef-40f2-aa1d-7b6584778618 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:15.481968 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-050f5c61-37ef-40f2-aa1d-7b6584778618 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:15.487985 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-050f5c61-37ef-40f2-aa1d-7b6584778618 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:15.488438 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-050f5c61-37ef-40f2-aa1d-7b6584778618 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:15.489216 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-050f5c61-37ef-40f2-aa1d-7b6584778618 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:15.489652 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-050f5c61-37ef-40f2-aa1d-7b6584778618 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:15.565674 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-050f5c61-37ef-40f2-aa1d-7b6584778618 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088006 May 13 13:35:15.566311 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 544/1111] 10.222.0.25 () {58 vars in 1274 bytes} [Fri May 13 13:35:15 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:35:15.627124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-149c5052-7ff3-4290-93de-3639d07ee5b6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:15.627806 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-149c5052-7ff3-4290-93de-3639d07ee5b6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:15.633866 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-149c5052-7ff3-4290-93de-3639d07ee5b6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:15.634323 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-149c5052-7ff3-4290-93de-3639d07ee5b6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:15.635094 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-149c5052-7ff3-4290-93de-3639d07ee5b6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:15.635532 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-149c5052-7ff3-4290-93de-3639d07ee5b6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:15.776126 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-149c5052-7ff3-4290-93de-3639d07ee5b6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:15.783641 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-149c5052-7ff3-4290-93de-3639d07ee5b6 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.160359 May 13 13:35:15.784207 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 568/1112] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:15 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:16.673463 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-880e0955-b2e7-4fd8-ac88-24997f91a76f req-8b35c7f8-d98c-4ea8-b1d4-2cf79ddd5308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80a314ae-726d-40d4-93d6-285e27a79564", "tag": "814f959d-cd9e-4950-a1f5-50171380b066"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:35:16.681379 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-880e0955-b2e7-4fd8-ac88-24997f91a76f req-8b35c7f8-d98c-4ea8-b1d4-2cf79ddd5308 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:16.681856 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-880e0955-b2e7-4fd8-ac88-24997f91a76f req-8b35c7f8-d98c-4ea8-b1d4-2cf79ddd5308 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:16.692706 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-880e0955-b2e7-4fd8-ac88-24997f91a76f req-8b35c7f8-d98c-4ea8-b1d4-2cf79ddd5308 service nova] Creating event network-changed:814f959d-cd9e-4950-a1f5-50171380b066 for instance 80a314ae-726d-40d4-93d6-285e27a79564 on hv-cinder-84159 May 13 13:35:16.698042 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-880e0955-b2e7-4fd8-ac88-24997f91a76f req-8b35c7f8-d98c-4ea8-b1d4-2cf79ddd5308 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028214 May 13 13:35:16.698631 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 545/1113] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:35:16.800415 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-887e31d9-ca92-46c7-b368-34a9324bea30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:16.801110 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-887e31d9-ca92-46c7-b368-34a9324bea30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:16.808034 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-887e31d9-ca92-46c7-b368-34a9324bea30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:16.808494 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-887e31d9-ca92-46c7-b368-34a9324bea30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:16.809268 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-887e31d9-ca92-46c7-b368-34a9324bea30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:16.809699 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-887e31d9-ca92-46c7-b368-34a9324bea30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:16.957094 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-887e31d9-ca92-46c7-b368-34a9324bea30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:16.966557 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-887e31d9-ca92-46c7-b368-34a9324bea30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1509 microversion: 2.1 time: 0.169421 May 13 13:35:16.968004 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 569/1114] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:16 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:16.986382 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f7fd18c8-b485-4c01-9a0b-74f401e51e22 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:35:16.987500 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f7fd18c8-b485-4c01-9a0b-74f401e51e22 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:16.995317 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f7fd18c8-b485-4c01-9a0b-74f401e51e22 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:16.996000 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f7fd18c8-b485-4c01-9a0b-74f401e51e22 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:16.996985 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f7fd18c8-b485-4c01-9a0b-74f401e51e22 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:16.997422 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f7fd18c8-b485-4c01-9a0b-74f401e51e22 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:17.215041 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-9f13b29c-4fa5-4be3-8e15-0c038fee12b3 req-42b9e8d6-879e-467d-966e-323e94bbecb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69", "name": "network-vif-unplugged", "status": "completed", "tag": "419528c3-a163-4096-aa94-d0e53f8d5d30"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:35:17.223283 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-9f13b29c-4fa5-4be3-8e15-0c038fee12b3 req-42b9e8d6-879e-467d-966e-323e94bbecb0 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:17.224048 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-9f13b29c-4fa5-4be3-8e15-0c038fee12b3 req-42b9e8d6-879e-467d-966e-323e94bbecb0 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:17.237619 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.compute.server_external_events [req-9f13b29c-4fa5-4be3-8e15-0c038fee12b3 req-42b9e8d6-879e-467d-966e-323e94bbecb0 service nova] Unable to find a host for instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69. Dropping event network-vif-unplugged {{(pid=117603) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 13 13:35:17.238555 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-9f13b29c-4fa5-4be3-8e15-0c038fee12b3 req-42b9e8d6-879e-467d-966e-323e94bbecb0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027361 May 13 13:35:17.239400 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 570/1115] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 13 13:35:17.283579 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f7fd18c8-b485-4c01-9a0b-74f401e51e22 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "POST /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69/action" status: 202 len: 0 microversion: 2.1 time: 0.301601 May 13 13:35:17.284359 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 546/1116] 10.222.0.25 () {60 vars in 1277 bytes} [Fri May 13 13:35:16 2022] POST /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:35:17.293090 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-81e446ae-9596-44be-a3ee-c74565ee8c30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:17.293716 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-81e446ae-9596-44be-a3ee-c74565ee8c30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:17.307690 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81e446ae-9596-44be-a3ee-c74565ee8c30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:17.308252 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81e446ae-9596-44be-a3ee-c74565ee8c30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:17.309274 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81e446ae-9596-44be-a3ee-c74565ee8c30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:17.310044 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-81e446ae-9596-44be-a3ee-c74565ee8c30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:17.487298 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-81e446ae-9596-44be-a3ee-c74565ee8c30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:17.495701 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-81e446ae-9596-44be-a3ee-c74565ee8c30 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1517 microversion: 2.1 time: 0.206978 May 13 13:35:17.496277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 571/1117] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:17 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1517 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:18.512155 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-d4caca7b-ae5d-4583-b90f-9a9296a1b5ff tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:18.512904 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-d4caca7b-ae5d-4583-b90f-9a9296a1b5ff tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:18.519499 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d4caca7b-ae5d-4583-b90f-9a9296a1b5ff tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:18.519949 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d4caca7b-ae5d-4583-b90f-9a9296a1b5ff tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:18.520721 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d4caca7b-ae5d-4583-b90f-9a9296a1b5ff tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:18.521154 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-d4caca7b-ae5d-4583-b90f-9a9296a1b5ff tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:18.707655 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-d4caca7b-ae5d-4583-b90f-9a9296a1b5ff tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:18.716045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-d4caca7b-ae5d-4583-b90f-9a9296a1b5ff tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1517 microversion: 2.1 time: 0.207745 May 13 13:35:18.716557 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 547/1118] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:18 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:19.732302 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8be1f37c-3b4d-4a36-9a55-c57b8ab30ca1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:19.732947 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8be1f37c-3b4d-4a36-9a55-c57b8ab30ca1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:19.739251 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8be1f37c-3b4d-4a36-9a55-c57b8ab30ca1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:19.739745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8be1f37c-3b4d-4a36-9a55-c57b8ab30ca1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:19.740517 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8be1f37c-3b4d-4a36-9a55-c57b8ab30ca1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:19.740954 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8be1f37c-3b4d-4a36-9a55-c57b8ab30ca1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:19.870215 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8be1f37c-3b4d-4a36-9a55-c57b8ab30ca1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:19.877715 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8be1f37c-3b4d-4a36-9a55-c57b8ab30ca1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1519 microversion: 2.1 time: 0.149245 May 13 13:35:19.878322 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 572/1119] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:19 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:20.896349 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9d9c620a-46c5-4b25-9021-7b4a5125faef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:20.896970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-9d9c620a-46c5-4b25-9021-7b4a5125faef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:20.903302 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9d9c620a-46c5-4b25-9021-7b4a5125faef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:20.903758 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9d9c620a-46c5-4b25-9021-7b4a5125faef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:20.904542 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9d9c620a-46c5-4b25-9021-7b4a5125faef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:20.904984 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9d9c620a-46c5-4b25-9021-7b4a5125faef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:21.064238 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-9d9c620a-46c5-4b25-9021-7b4a5125faef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:21.071544 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-9d9c620a-46c5-4b25-9021-7b4a5125faef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1575 microversion: 2.1 time: 0.179270 May 13 13:35:21.072116 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 548/1120] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:20 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:22.089343 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-8d2b8e3a-8b11-47dd-8a22-92800940601b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:22.090023 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-8d2b8e3a-8b11-47dd-8a22-92800940601b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:22.096756 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8d2b8e3a-8b11-47dd-8a22-92800940601b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:22.097216 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8d2b8e3a-8b11-47dd-8a22-92800940601b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:22.098035 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8d2b8e3a-8b11-47dd-8a22-92800940601b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:22.098490 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-8d2b8e3a-8b11-47dd-8a22-92800940601b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:22.230810 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-8d2b8e3a-8b11-47dd-8a22-92800940601b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:22.238833 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-8d2b8e3a-8b11-47dd-8a22-92800940601b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1575 microversion: 2.1 time: 0.154162 May 13 13:35:22.239395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 573/1121] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:22 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:23.255623 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-b33a1db3-7aae-410e-af89-246d39161a1b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:23.256246 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-b33a1db3-7aae-410e-af89-246d39161a1b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:23.262704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b33a1db3-7aae-410e-af89-246d39161a1b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:23.263164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b33a1db3-7aae-410e-af89-246d39161a1b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:23.263938 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b33a1db3-7aae-410e-af89-246d39161a1b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:23.264387 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-b33a1db3-7aae-410e-af89-246d39161a1b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:23.392651 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-b33a1db3-7aae-410e-af89-246d39161a1b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:23.399996 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-b33a1db3-7aae-410e-af89-246d39161a1b tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1575 microversion: 2.1 time: 0.148232 May 13 13:35:23.400570 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 549/1122] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:23 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:24.416758 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2aeec23a-367d-47ae-a2e9-7aa3945a70b2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:24.417443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2aeec23a-367d-47ae-a2e9-7aa3945a70b2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:24.423701 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2aeec23a-367d-47ae-a2e9-7aa3945a70b2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:24.424149 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2aeec23a-367d-47ae-a2e9-7aa3945a70b2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:24.424908 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2aeec23a-367d-47ae-a2e9-7aa3945a70b2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:24.425339 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2aeec23a-367d-47ae-a2e9-7aa3945a70b2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:24.554453 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2aeec23a-367d-47ae-a2e9-7aa3945a70b2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:24.562266 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2aeec23a-367d-47ae-a2e9-7aa3945a70b2 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1575 microversion: 2.1 time: 0.149238 May 13 13:35:24.566149 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 574/1123] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:24 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:35:25.579529 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1c296e9b-f36b-4ff8-ac8a-28d13c44866d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:25.580134 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1c296e9b-f36b-4ff8-ac8a-28d13c44866d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:25.586323 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1c296e9b-f36b-4ff8-ac8a-28d13c44866d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:25.586772 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1c296e9b-f36b-4ff8-ac8a-28d13c44866d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:25.587577 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1c296e9b-f36b-4ff8-ac8a-28d13c44866d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:25.588493 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1c296e9b-f36b-4ff8-ac8a-28d13c44866d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:25.728389 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1c296e9b-f36b-4ff8-ac8a-28d13c44866d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:25.735908 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1c296e9b-f36b-4ff8-ac8a-28d13c44866d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1575 microversion: 2.1 time: 0.160370 May 13 13:35:25.736482 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 550/1124] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:25 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:26.753377 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3fef47cc-c0b9-4077-9f49-8782208535a0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:26.753930 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-3fef47cc-c0b9-4077-9f49-8782208535a0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:26.760269 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fef47cc-c0b9-4077-9f49-8782208535a0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:26.760729 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fef47cc-c0b9-4077-9f49-8782208535a0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:26.761501 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fef47cc-c0b9-4077-9f49-8782208535a0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:26.761976 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-3fef47cc-c0b9-4077-9f49-8782208535a0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:26.888765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-3fef47cc-c0b9-4077-9f49-8782208535a0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:26.896113 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3fef47cc-c0b9-4077-9f49-8782208535a0 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1575 microversion: 2.1 time: 0.146670 May 13 13:35:26.896677 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 575/1125] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:26 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:27.913268 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-1d3acdec-b539-4d95-b175-114e9eeb8f35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:27.913823 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-1d3acdec-b539-4d95-b175-114e9eeb8f35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:27.920271 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1d3acdec-b539-4d95-b175-114e9eeb8f35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:27.920724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1d3acdec-b539-4d95-b175-114e9eeb8f35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:27.921499 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1d3acdec-b539-4d95-b175-114e9eeb8f35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:27.921968 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-1d3acdec-b539-4d95-b175-114e9eeb8f35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:28.054495 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-1d3acdec-b539-4d95-b175-114e9eeb8f35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:28.062371 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-1d3acdec-b539-4d95-b175-114e9eeb8f35 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1575 microversion: 2.1 time: 0.153072 May 13 13:35:28.062942 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 551/1126] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:27 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:29.079540 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-2de2e7c4-54e2-4bfe-9fbc-8ba19640ba2f tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:29.080185 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-2de2e7c4-54e2-4bfe-9fbc-8ba19640ba2f tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:29.087653 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2de2e7c4-54e2-4bfe-9fbc-8ba19640ba2f tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:29.087653 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2de2e7c4-54e2-4bfe-9fbc-8ba19640ba2f tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:29.087653 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2de2e7c4-54e2-4bfe-9fbc-8ba19640ba2f tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:29.088100 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-2de2e7c4-54e2-4bfe-9fbc-8ba19640ba2f tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:29.234403 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-2de2e7c4-54e2-4bfe-9fbc-8ba19640ba2f tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:29.241903 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-2de2e7c4-54e2-4bfe-9fbc-8ba19640ba2f tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1575 microversion: 2.1 time: 0.166318 May 13 13:35:29.242481 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 576/1127] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:29 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:30.259355 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-594e776f-8f19-4d7e-b46a-3713937e471e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:30.259948 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-594e776f-8f19-4d7e-b46a-3713937e471e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:30.266214 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-594e776f-8f19-4d7e-b46a-3713937e471e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:30.266663 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-594e776f-8f19-4d7e-b46a-3713937e471e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:30.267422 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-594e776f-8f19-4d7e-b46a-3713937e471e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:30.267856 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-594e776f-8f19-4d7e-b46a-3713937e471e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:30.394801 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-594e776f-8f19-4d7e-b46a-3713937e471e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:30.402533 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-594e776f-8f19-4d7e-b46a-3713937e471e tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1575 microversion: 2.1 time: 0.146991 May 13 13:35:30.403097 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 552/1128] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:30 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:31.329647 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-cb3874bb-a228-423b-b29b-854fa0c00762 req-07f37116-b840-4f36-bc11-a18c682ec5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69", "name": "network-vif-plugged", "status": "completed", "tag": "419528c3-a163-4096-aa94-d0e53f8d5d30"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:35:31.338245 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-cb3874bb-a228-423b-b29b-854fa0c00762 req-07f37116-b840-4f36-bc11-a18c682ec5de service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:31.338694 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-cb3874bb-a228-423b-b29b-854fa0c00762 req-07f37116-b840-4f36-bc11-a18c682ec5de service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:31.349441 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-cb3874bb-a228-423b-b29b-854fa0c00762 req-07f37116-b840-4f36-bc11-a18c682ec5de service nova] Creating event network-vif-plugged:419528c3-a163-4096-aa94-d0e53f8d5d30 for instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 on hv-cinder-84159 May 13 13:35:31.355001 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-cb3874bb-a228-423b-b29b-854fa0c00762 req-07f37116-b840-4f36-bc11-a18c682ec5de service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029046 May 13 13:35:31.355591 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 577/1129] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:35:31.419496 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-ac33260b-2bbf-409d-bed0-2553b871c6ad tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:31.420146 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-ac33260b-2bbf-409d-bed0-2553b871c6ad tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:31.426786 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ac33260b-2bbf-409d-bed0-2553b871c6ad tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:31.427191 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ac33260b-2bbf-409d-bed0-2553b871c6ad tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:31.427970 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ac33260b-2bbf-409d-bed0-2553b871c6ad tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:31.428420 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-ac33260b-2bbf-409d-bed0-2553b871c6ad tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:31.566464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-ac33260b-2bbf-409d-bed0-2553b871c6ad tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:31.574440 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-ac33260b-2bbf-409d-bed0-2553b871c6ad tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1575 microversion: 2.1 time: 0.159517 May 13 13:35:31.575030 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 553/1130] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:31 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:32.592647 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-04903374-43fd-4a41-a321-4c0320c267ef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:32.593380 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-04903374-43fd-4a41-a321-4c0320c267ef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:32.599564 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04903374-43fd-4a41-a321-4c0320c267ef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:32.600047 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04903374-43fd-4a41-a321-4c0320c267ef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:32.600851 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04903374-43fd-4a41-a321-4c0320c267ef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:32.601268 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-04903374-43fd-4a41-a321-4c0320c267ef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:32.729446 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-04903374-43fd-4a41-a321-4c0320c267ef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:32.736630 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-04903374-43fd-4a41-a321-4c0320c267ef tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1575 microversion: 2.1 time: 0.148657 May 13 13:35:32.737195 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 578/1131] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:32 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:33.754181 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-e3a99732-24c7-4784-8033-0c78761c5120 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:33.754725 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-e3a99732-24c7-4784-8033-0c78761c5120 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:33.761022 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e3a99732-24c7-4784-8033-0c78761c5120 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:33.761480 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e3a99732-24c7-4784-8033-0c78761c5120 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:33.762272 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e3a99732-24c7-4784-8033-0c78761c5120 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:33.762713 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-e3a99732-24c7-4784-8033-0c78761c5120 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:33.892334 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-e3a99732-24c7-4784-8033-0c78761c5120 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:35:33.899653 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-e3a99732-24c7-4784-8033-0c78761c5120 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1562 microversion: 2.1 time: 0.149633 May 13 13:35:33.900261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 554/1132] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:35:33 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:35:48.826636 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-5e583c79-fe88-40a3-bb25-ad9c381f8bd5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:48.827163 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-5e583c79-fe88-40a3-bb25-ad9c381f8bd5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:48.833498 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5e583c79-fe88-40a3-bb25-ad9c381f8bd5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:48.833996 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5e583c79-fe88-40a3-bb25-ad9c381f8bd5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:48.834786 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5e583c79-fe88-40a3-bb25-ad9c381f8bd5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:48.835214 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-5e583c79-fe88-40a3-bb25-ad9c381f8bd5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:48.857713 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-5e583c79-fe88-40a3-bb25-ad9c381f8bd5 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/ips" status: 200 len: 150 microversion: 2.1 time: 0.035007 May 13 13:35:48.858307 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 579/1133] 10.222.0.25 () {58 vars in 1247 bytes} [Fri May 13 13:35:48 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:35:50.460464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2004354b-63a3-42e5-9ee4-a1316b7f397c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a950337d-4c31-4ffc-a77e-78f644625fec"}} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:35:50.461843 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2004354b-63a3-42e5-9ee4-a1316b7f397c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:50.468884 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2004354b-63a3-42e5-9ee4-a1316b7f397c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:50.469334 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2004354b-63a3-42e5-9ee4-a1316b7f397c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:50.470122 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2004354b-63a3-42e5-9ee4-a1316b7f397c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:50.470560 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2004354b-63a3-42e5-9ee4-a1316b7f397c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:51.290688 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2004354b-63a3-42e5-9ee4-a1316b7f397c tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "POST /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833458 May 13 13:35:51.291307 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 555/1134] 10.222.0.25 () {60 vars in 1322 bytes} [Fri May 13 13:35:50 2022] POST /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/os-volume_attachments => generated 194 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:35:58.848088 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-72208498-c676-4352-a350-35147ee61768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:58.848625 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-72208498-c676-4352-a350-35147ee61768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:58.854976 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-72208498-c676-4352-a350-35147ee61768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:58.855349 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-72208498-c676-4352-a350-35147ee61768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:58.856115 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-72208498-c676-4352-a350-35147ee61768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:58.856551 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-72208498-c676-4352-a350-35147ee61768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:58.933263 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.objects.instance [None req-72208498-c676-4352-a350-35147ee61768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lazy-loading 'services' on Instance uuid 80a314ae-726d-40d4-93d6-285e27a79564 {{(pid=117603) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:35:59.191540 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-72208498-c676-4352-a350-35147ee61768 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/os-volume_attachments/a950337d-4c31-4ffc-a77e-78f644625fec" status: 202 len: 0 microversion: 2.1 time: 0.347473 May 13 13:35:59.192059 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 580/1135] 10.222.0.25 () {58 vars in 1415 bytes} [Fri May 13 13:35:58 2022] DELETE /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/os-volume_attachments/a950337d-4c31-4ffc-a77e-78f644625fec => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:35:59.202225 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-f0422db1-9770-4de7-aba3-39cf70a6d236 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:35:59.203295 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-f0422db1-9770-4de7-aba3-39cf70a6d236 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:35:59.209502 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f0422db1-9770-4de7-aba3-39cf70a6d236 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:59.209980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f0422db1-9770-4de7-aba3-39cf70a6d236 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:59.210752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f0422db1-9770-4de7-aba3-39cf70a6d236 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:35:59.211442 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-f0422db1-9770-4de7-aba3-39cf70a6d236 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:35:59.241495 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-f0422db1-9770-4de7-aba3-39cf70a6d236 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 May 13 13:35:59.242069 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 556/1136] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:35:59 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:36:00.253174 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-c09313ba-d31d-4026-8174-fa6b6dc47a72 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:00.254305 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-c09313ba-d31d-4026-8174-fa6b6dc47a72 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:00.260914 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c09313ba-d31d-4026-8174-fa6b6dc47a72 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:00.265283 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c09313ba-d31d-4026-8174-fa6b6dc47a72 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:00.265283 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c09313ba-d31d-4026-8174-fa6b6dc47a72 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:00.265283 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-c09313ba-d31d-4026-8174-fa6b6dc47a72 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:00.292745 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-c09313ba-d31d-4026-8174-fa6b6dc47a72 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043894 May 13 13:36:00.293300 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 581/1137] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:36:00 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:36:01.304712 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6dd2f793-8286-4d21-b648-75a5aa681619 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:01.305678 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6dd2f793-8286-4d21-b648-75a5aa681619 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:01.312041 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6dd2f793-8286-4d21-b648-75a5aa681619 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:01.312495 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6dd2f793-8286-4d21-b648-75a5aa681619 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:01.313272 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6dd2f793-8286-4d21-b648-75a5aa681619 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:01.313714 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6dd2f793-8286-4d21-b648-75a5aa681619 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:01.344416 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6dd2f793-8286-4d21-b648-75a5aa681619 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043653 May 13 13:36:01.344965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 557/1138] 10.222.0.25 () {58 vars in 1301 bytes} [Fri May 13 13:36:01 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:36:01.399990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-912e06bd-4295-417a-80d2-ee94e1cc096d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:01.400487 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-912e06bd-4295-417a-80d2-ee94e1cc096d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:01.406647 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-912e06bd-4295-417a-80d2-ee94e1cc096d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:01.407097 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-912e06bd-4295-417a-80d2-ee94e1cc096d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:01.407855 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-912e06bd-4295-417a-80d2-ee94e1cc096d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:01.408293 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-912e06bd-4295-417a-80d2-ee94e1cc096d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:01.432695 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-912e06bd-4295-417a-80d2-ee94e1cc096d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:36:01.766171 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-912e06bd-4295-417a-80d2-ee94e1cc096d tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 204 len: 0 microversion: 2.1 time: 0.369614 May 13 13:36:01.766712 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 582/1139] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:36:01 2022] DELETE /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:36:01.775532 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-cb2481f8-ddcc-407f-b940-b1eb49accd32 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:01.776145 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-cb2481f8-ddcc-407f-b940-b1eb49accd32 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:01.782163 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cb2481f8-ddcc-407f-b940-b1eb49accd32 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:01.782599 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cb2481f8-ddcc-407f-b940-b1eb49accd32 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:01.783370 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cb2481f8-ddcc-407f-b940-b1eb49accd32 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:01.783806 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-cb2481f8-ddcc-407f-b940-b1eb49accd32 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:01.918544 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-cb2481f8-ddcc-407f-b940-b1eb49accd32 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:01.925767 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-cb2481f8-ddcc-407f-b940-b1eb49accd32 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1682 microversion: 2.1 time: 0.154748 May 13 13:36:01.926365 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 558/1140] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:01 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:02.943447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9d3e7407-2a4c-49c4-8403-0b96a430d711 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:02.944070 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9d3e7407-2a4c-49c4-8403-0b96a430d711 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:02.951082 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d3e7407-2a4c-49c4-8403-0b96a430d711 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:02.951538 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d3e7407-2a4c-49c4-8403-0b96a430d711 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:02.952314 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d3e7407-2a4c-49c4-8403-0b96a430d711 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:02.952754 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9d3e7407-2a4c-49c4-8403-0b96a430d711 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:03.079970 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-9d3e7407-2a4c-49c4-8403-0b96a430d711 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:03.087586 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9d3e7407-2a4c-49c4-8403-0b96a430d711 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1682 microversion: 2.1 time: 0.148470 May 13 13:36:03.088156 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 583/1141] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:02 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:36:04.105724 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-9be1da44-2ddb-4b1f-a0e7-111c14658717 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:04.106335 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-9be1da44-2ddb-4b1f-a0e7-111c14658717 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:04.113029 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9be1da44-2ddb-4b1f-a0e7-111c14658717 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:04.113986 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9be1da44-2ddb-4b1f-a0e7-111c14658717 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:04.114855 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9be1da44-2ddb-4b1f-a0e7-111c14658717 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:04.115623 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-9be1da44-2ddb-4b1f-a0e7-111c14658717 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:04.195902 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-9be1da44-2ddb-4b1f-a0e7-111c14658717 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:04.203328 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-9be1da44-2ddb-4b1f-a0e7-111c14658717 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1614 microversion: 2.1 time: 0.102316 May 13 13:36:04.203909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 559/1142] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:04 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:04.473583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-39251cbe-388b-4ab4-9e8d-4e96249a4643 req-7870e14d-7e54-48a5-b3c2-eccb57174ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80a314ae-726d-40d4-93d6-285e27a79564", "name": "network-vif-deleted", "tag": "814f959d-cd9e-4950-a1f5-50171380b066"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:36:04.484113 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-39251cbe-388b-4ab4-9e8d-4e96249a4643 req-7870e14d-7e54-48a5-b3c2-eccb57174ee4 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:04.484570 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-39251cbe-388b-4ab4-9e8d-4e96249a4643 req-7870e14d-7e54-48a5-b3c2-eccb57174ee4 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:04.503136 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-39251cbe-388b-4ab4-9e8d-4e96249a4643 req-7870e14d-7e54-48a5-b3c2-eccb57174ee4 service nova] Creating event network-vif-deleted:814f959d-cd9e-4950-a1f5-50171380b066 for instance 80a314ae-726d-40d4-93d6-285e27a79564 on hv-cinder-84159 May 13 13:36:04.508277 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-39251cbe-388b-4ab4-9e8d-4e96249a4643 req-7870e14d-7e54-48a5-b3c2-eccb57174ee4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099872 May 13 13:36:04.509343 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 584/1143] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:36:05.220899 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-19f358c3-ee8d-4c0e-a6f5-0682435111d3 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:05.221520 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-19f358c3-ee8d-4c0e-a6f5-0682435111d3 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:05.228605 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-19f358c3-ee8d-4c0e-a6f5-0682435111d3 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:05.229060 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-19f358c3-ee8d-4c0e-a6f5-0682435111d3 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:05.229867 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-19f358c3-ee8d-4c0e-a6f5-0682435111d3 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:05.230306 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-19f358c3-ee8d-4c0e-a6f5-0682435111d3 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:05.261683 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-19f358c3-ee8d-4c0e-a6f5-0682435111d3 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:05.262172 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-19f358c3-ee8d-4c0e-a6f5-0682435111d3 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:05.262623 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-19f358c3-ee8d-4c0e-a6f5-0682435111d3 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lazy-loading 'fault' on Instance uuid 80a314ae-726d-40d4-93d6-285e27a79564 {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:36:05.305015 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-19f358c3-ee8d-4c0e-a6f5-0682435111d3 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79dbde2a65224927af4bb5e77090496c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e72f39546704606927bcefdc0f13235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:05.313090 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-19f358c3-ee8d-4c0e-a6f5-0682435111d3 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 200 len: 1331 microversion: 2.1 time: 0.096313 May 13 13:36:05.313679 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 560/1144] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:05 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:06.331285 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-787791ee-0e58-4572-90e5-0eff6ba082d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:06.331993 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-787791ee-0e58-4572-90e5-0eff6ba082d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:06.339000 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-787791ee-0e58-4572-90e5-0eff6ba082d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:06.340609 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-787791ee-0e58-4572-90e5-0eff6ba082d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:06.340609 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-787791ee-0e58-4572-90e5-0eff6ba082d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:06.340813 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-787791ee-0e58-4572-90e5-0eff6ba082d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:06.353435 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-787791ee-0e58-4572-90e5-0eff6ba082d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-787791ee-0e58-4572-90e5-0eff6ba082d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 HTTP/1.1 May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:36:06.355084 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:36:06.356800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:06.356800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:06.356800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:06.356800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:06.356800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:06.356800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:36:06.356800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:36:06.356800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:36:06.356800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:06.356800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:36:06.356800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:06.356800 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '80a314ae-726d-40d4-93d6-285e27a79564'} May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:06.357990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:06.359628 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:06.361120 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-787791ee-0e58-4572-90e5-0eff6ba082d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 404 to user: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:06.361120 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-787791ee-0e58-4572-90e5-0eff6ba082d6 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 404 len: 111 microversion: 2.1 time: 0.029900 May 13 13:36:06.361120 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 585/1145] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:06 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:36:06.365312 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-4445021a-b4d1-4c6e-8a37-a9da7a75d433 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '.version_select at 0x7faaa3228b80>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:06.462980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-4445021a-b4d1-4c6e-8a37-a9da7a75d433 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-687142636" status: 202 len: 0 microversion: 2.1 time: 0.101457 May 13 13:36:06.463560 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 561/1146] 10.222.0.25 () {58 vars in 1217 bytes} [Fri May 13 13:36:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-687142636 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:36:08.586717 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-19c50e1a-700c-4e70-b64a-cdb9d5da6d26 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:08.587214 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-19c50e1a-700c-4e70-b64a-cdb9d5da6d26 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:08.594082 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-19c50e1a-700c-4e70-b64a-cdb9d5da6d26 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:08.594531 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-19c50e1a-700c-4e70-b64a-cdb9d5da6d26 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:08.595290 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-19c50e1a-700c-4e70-b64a-cdb9d5da6d26 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:08.595724 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-19c50e1a-700c-4e70-b64a-cdb9d5da6d26 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:08.608643 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-19c50e1a-700c-4e70-b64a-cdb9d5da6d26 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-19c50e1a-700c-4e70-b64a-cdb9d5da6d26 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 HTTP/1.1 May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:36:08.610181 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:36:08.611765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:08.611765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:08.611765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:08.611765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:08.611765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:08.611765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:36:08.611765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:36:08.611765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:36:08.611765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:08.611765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:36:08.611765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:08.611765 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '80a314ae-726d-40d4-93d6-285e27a79564'} May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:08.612655 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:08.614175 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:08.615659 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-19c50e1a-700c-4e70-b64a-cdb9d5da6d26 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 404 to user: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:08.615659 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-19c50e1a-700c-4e70-b64a-cdb9d5da6d26 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 404 len: 111 microversion: 2.1 time: 0.028920 May 13 13:36:08.615659 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 586/1147] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:36:08 2022] DELETE /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:36:08.620208 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6cc587d7-e442-4a7f-bd20-40ea1787bcbc tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:08.620790 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-6cc587d7-e442-4a7f-bd20-40ea1787bcbc tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 80a314ae-726d-40d4-93d6-285e27a79564] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:08.627166 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6cc587d7-e442-4a7f-bd20-40ea1787bcbc tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:08.627614 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6cc587d7-e442-4a7f-bd20-40ea1787bcbc tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:08.628376 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6cc587d7-e442-4a7f-bd20-40ea1787bcbc tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:08.628811 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-6cc587d7-e442-4a7f-bd20-40ea1787bcbc tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:08.642024 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-6cc587d7-e442-4a7f-bd20-40ea1787bcbc tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6cc587d7-e442-4a7f-bd20-40ea1787bcbc tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 HTTP/1.1 May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:36:08.643628 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:36:08.645240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:08.645240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:08.645240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:08.645240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:08.645240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:08.645240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:36:08.645240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:36:08.645240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:36:08.645240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:08.645240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:36:08.645240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:08.645240 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '80a314ae-726d-40d4-93d6-285e27a79564'} May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:08.646298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. May 13 13:36:08.647881 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:08.649332 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-6cc587d7-e442-4a7f-bd20-40ea1787bcbc tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 404 to user: Instance 80a314ae-726d-40d4-93d6-285e27a79564 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:08.649332 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-6cc587d7-e442-4a7f-bd20-40ea1787bcbc tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564" status: 404 len: 111 microversion: 2.1 time: 0.029057 May 13 13:36:08.649332 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 562/1148] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:08 2022] GET /compute/v2.1/servers/80a314ae-726d-40d4-93d6-285e27a79564 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:36:09.945513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9e34b7bd-69f0-4d17-8b97-3f683b1429d9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:09.946082 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-9e34b7bd-69f0-4d17-8b97-3f683b1429d9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:09.953766 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e34b7bd-69f0-4d17-8b97-3f683b1429d9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:09.954270 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e34b7bd-69f0-4d17-8b97-3f683b1429d9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:09.955043 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e34b7bd-69f0-4d17-8b97-3f683b1429d9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:09.955481 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-9e34b7bd-69f0-4d17-8b97-3f683b1429d9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:09.969869 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-9e34b7bd-69f0-4d17-8b97-3f683b1429d9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9e34b7bd-69f0-4d17-8b97-3f683b1429d9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 HTTP/1.1 May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:36:09.971449 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:36:09.973045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:09.973045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:09.973045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:09.973045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:09.973045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:09.973045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:36:09.973045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:36:09.973045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:36:09.973045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:09.973045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:36:09.973045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:36:09.973045 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '2e839d2a-15b4-48ad-a357-ad4a871f1818'} May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:09.974129 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:36:09.975675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:09.977319 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-9e34b7bd-69f0-4d17-8b97-3f683b1429d9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 404 to user: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:09.977319 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-9e34b7bd-69f0-4d17-8b97-3f683b1429d9 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 404 len: 111 microversion: 2.1 time: 0.034753 May 13 13:36:09.977319 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 587/1149] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:36:09 2022] DELETE /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:36:09.981348 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5a3b8fdb-107b-4601-a750-5902fa05d08f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:09.981997 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-5a3b8fdb-107b-4601-a750-5902fa05d08f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 2e839d2a-15b4-48ad-a357-ad4a871f1818] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:09.988277 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5a3b8fdb-107b-4601-a750-5902fa05d08f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:09.988736 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5a3b8fdb-107b-4601-a750-5902fa05d08f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:09.989515 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5a3b8fdb-107b-4601-a750-5902fa05d08f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:09.989989 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5a3b8fdb-107b-4601-a750-5902fa05d08f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:10.002973 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-5a3b8fdb-107b-4601-a750-5902fa05d08f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5a3b8fdb-107b-4601-a750-5902fa05d08f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 HTTP/1.1 May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:36:10.004514 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:36:10.006142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:10.006142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:10.006142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:10.006142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:10.006142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:10.006142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:36:10.006142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:36:10.006142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:36:10.006142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:10.006142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:36:10.006142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:36:10.006142 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '2e839d2a-15b4-48ad-a357-ad4a871f1818'} May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:10.007179 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. May 13 13:36:10.008697 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:10.010227 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5a3b8fdb-107b-4601-a750-5902fa05d08f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 404 to user: Instance 2e839d2a-15b4-48ad-a357-ad4a871f1818 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:10.010227 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-5a3b8fdb-107b-4601-a750-5902fa05d08f tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818" status: 404 len: 111 microversion: 2.1 time: 0.028384 May 13 13:36:10.010227 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 563/1150] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:09 2022] GET /compute/v2.1/servers/2e839d2a-15b4-48ad-a357-ad4a871f1818 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 13:36:10.014677 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-44a1ea63-8ede-41b3-ab23-5041e4969cea tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:10.015173 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-44a1ea63-8ede-41b3-ab23-5041e4969cea tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:10.020880 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-44a1ea63-8ede-41b3-ab23-5041e4969cea tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:10.021324 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-44a1ea63-8ede-41b3-ab23-5041e4969cea tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:10.022116 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-44a1ea63-8ede-41b3-ab23-5041e4969cea tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:10.022549 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-44a1ea63-8ede-41b3-ab23-5041e4969cea tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:10.036082 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-44a1ea63-8ede-41b3-ab23-5041e4969cea tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-44a1ea63-8ede-41b3-ab23-5041e4969cea tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 HTTP/1.1 May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:36:10.037581 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:36:10.039152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:10.039152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:10.039152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:10.039152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:10.039152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:10.039152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:36:10.039152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:36:10.039152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:36:10.039152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:10.039152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:36:10.039152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:36:10.039152 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': '75183d1d-a3aa-4781-8289-ff286fe85376'} May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:10.040132 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:36:10.041362 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:10.042754 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-44a1ea63-8ede-41b3-ab23-5041e4969cea tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 404 to user: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:10.042754 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-44a1ea63-8ede-41b3-ab23-5041e4969cea tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 404 len: 111 microversion: 2.1 time: 0.028656 May 13 13:36:10.042754 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 588/1151] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:36:10 2022] DELETE /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:36:10.047181 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-544911f1-bd02-4f0b-9ad1-d0cc1ad73492 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:10.047801 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-544911f1-bd02-4f0b-9ad1-d0cc1ad73492 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: 75183d1d-a3aa-4781-8289-ff286fe85376] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:10.053639 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-544911f1-bd02-4f0b-9ad1-d0cc1ad73492 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:10.054134 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-544911f1-bd02-4f0b-9ad1-d0cc1ad73492 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:10.054947 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-544911f1-bd02-4f0b-9ad1-d0cc1ad73492 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:10.055388 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-544911f1-bd02-4f0b-9ad1-d0cc1ad73492 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:10.068441 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-544911f1-bd02-4f0b-9ad1-d0cc1ad73492 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-544911f1-bd02-4f0b-9ad1-d0cc1ad73492 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 HTTP/1.1 May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:36:10.069994 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:36:10.071704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:10.071704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:10.071704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:10.071704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:10.071704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:10.071704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:36:10.071704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:36:10.071704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:36:10.071704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:10.071704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:36:10.071704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:36:10.071704 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '75183d1d-a3aa-4781-8289-ff286fe85376'} May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:10.072734 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. May 13 13:36:10.074965 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:10.076230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-544911f1-bd02-4f0b-9ad1-d0cc1ad73492 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 404 to user: Instance 75183d1d-a3aa-4781-8289-ff286fe85376 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:10.076230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-544911f1-bd02-4f0b-9ad1-d0cc1ad73492 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376" status: 404 len: 111 microversion: 2.1 time: 0.028008 May 13 13:36:10.076230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 564/1152] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:10 2022] GET /compute/v2.1/servers/75183d1d-a3aa-4781-8289-ff286fe85376 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:36:11.344200 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-448f8c3e-1429-4dfb-8524-eb653ff5e954 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:11.344717 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-448f8c3e-1429-4dfb-8524-eb653ff5e954 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:11.351110 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-448f8c3e-1429-4dfb-8524-eb653ff5e954 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:11.351566 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-448f8c3e-1429-4dfb-8524-eb653ff5e954 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:11.352366 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-448f8c3e-1429-4dfb-8524-eb653ff5e954 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:11.352809 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-448f8c3e-1429-4dfb-8524-eb653ff5e954 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:11.365957 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-448f8c3e-1429-4dfb-8524-eb653ff5e954 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-448f8c3e-1429-4dfb-8524-eb653ff5e954 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 HTTP/1.1 May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:36:11.367474 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:36:11.369237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:11.369237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:11.369237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:11.369237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:11.369237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:11.369237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:36:11.369237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:36:11.369237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:36:11.369237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:11.369237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:36:11.369237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:36:11.369237 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'adbc38e8-eda7-4bc6-86c3-be36a0ed8e78'} May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:11.374443 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:36:11.376106 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:11.377697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-448f8c3e-1429-4dfb-8524-eb653ff5e954 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 404 to user: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:11.377697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-448f8c3e-1429-4dfb-8524-eb653ff5e954 tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "DELETE /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 404 len: 111 microversion: 2.1 time: 0.028607 May 13 13:36:11.377697 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 589/1153] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:36:11 2022] DELETE /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:36:11.380749 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5f43062c-f97f-44c8-a318-19c09314241a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:11.381445 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-5f43062c-f97f-44c8-a318-19c09314241a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] [instance: adbc38e8-eda7-4bc6-86c3-be36a0ed8e78] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:11.388515 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5f43062c-f97f-44c8-a318-19c09314241a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:11.388961 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5f43062c-f97f-44c8-a318-19c09314241a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:11.389729 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5f43062c-f97f-44c8-a318-19c09314241a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:11.390188 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-5f43062c-f97f-44c8-a318-19c09314241a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:11.403471 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-5f43062c-f97f-44c8-a318-19c09314241a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] HTTP exception thrown: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5f43062c-f97f-44c8-a318-19c09314241a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Request method failure captured: May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 HTTP/1.1 May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl2d9HPVE6RN0Rl7rglPe5KbFxjgR6Ovd5DkVQLV4Sa5kh-0qbmDyQMm2B14uXJxEs7FvtTz_8vBw-E_KzwPkc5CZEuhnET9PV0oO2WAlNokb8aR49cuZ1EpM2hcf71CJESa2i4OQ1AkTpAT1qoM3uKa0RlaTuV0jBOG_C_DLYWkKJg May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:36:11.408716 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:36:11.410397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1e72f39546704606927bcefdc0f13235", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1e72f39546704606927bcefdc0f13235"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1e72f39546704606927bcefdc0f13235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:11.410397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:11.410397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: 1e72f39546704606927bcefdc0f13235 May 13 13:36:11.410397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-867975258 May 13 13:36:11.410397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:11.410397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:36:11.410397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:36:11.410397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 79dbde2a65224927af4bb5e77090496c May 13 13:36:11.410397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-AttachVolumeNegativeTest-867975258-project May 13 13:36:11.410397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:36:11.410397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:36:11.410397 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': 'adbc38e8-eda7-4bc6-86c3-be36a0ed8e78'} May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:11.411261 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. May 13 13:36:11.413298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:11.414728 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-5f43062c-f97f-44c8-a318-19c09314241a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] Returning 404 to user: Instance adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:11.414728 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-5f43062c-f97f-44c8-a318-19c09314241a tempest-AttachVolumeNegativeTest-867975258 tempest-AttachVolumeNegativeTest-867975258-project] 10.222.0.25 "GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78" status: 404 len: 111 microversion: 2.1 time: 0.029374 May 13 13:36:11.414728 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 565/1154] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:11 2022] GET /compute/v2.1/servers/adbc38e8-eda7-4bc6-86c3-be36a0ed8e78 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:36:25.777479 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-7217db80-5c41-4575-b506-6bc36238d928 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:25.778002 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7217db80-5c41-4575-b506-6bc36238d928 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:25.782902 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-cff39ba3-65a4-4f5b-9b8c-a56eeabb8c72 req-f311e873-3808-4a6e-8829-d1ebb1195dfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ec7b2f-151a-4074-9dd9-b7a7b0e45c12", "tag": "acd2f1ab-4dd9-492b-8a9b-447c531381e8"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:36:25.784825 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7217db80-5c41-4575-b506-6bc36238d928 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:25.785290 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7217db80-5c41-4575-b506-6bc36238d928 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:25.786100 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7217db80-5c41-4575-b506-6bc36238d928 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:25.786545 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-7217db80-5c41-4575-b506-6bc36238d928 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:25.790849 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-cff39ba3-65a4-4f5b-9b8c-a56eeabb8c72 req-f311e873-3808-4a6e-8829-d1ebb1195dfd service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:25.791296 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-cff39ba3-65a4-4f5b-9b8c-a56eeabb8c72 req-f311e873-3808-4a6e-8829-d1ebb1195dfd service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:25.803375 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-cff39ba3-65a4-4f5b-9b8c-a56eeabb8c72 req-f311e873-3808-4a6e-8829-d1ebb1195dfd service nova] Creating event network-changed:acd2f1ab-4dd9-492b-8a9b-447c531381e8 for instance 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 on hv-cinder-84159 May 13 13:36:25.809675 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-cff39ba3-65a4-4f5b-9b8c-a56eeabb8c72 req-f311e873-3808-4a6e-8829-d1ebb1195dfd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030554 May 13 13:36:25.810306 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 566/1155] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:36:25.824266 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-7217db80-5c41-4575-b506-6bc36238d928 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:36:26.329082 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-7217db80-5c41-4575-b506-6bc36238d928 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "DELETE /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 204 len: 0 microversion: 2.1 time: 0.552684 May 13 13:36:26.333450 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 590/1156] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:36:25 2022] DELETE /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:36:26.339866 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-8ab76097-9512-422b-af8f-ba6a8265f40e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:26.340729 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-8ab76097-9512-422b-af8f-ba6a8265f40e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:26.349955 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8ab76097-9512-422b-af8f-ba6a8265f40e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:26.349955 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8ab76097-9512-422b-af8f-ba6a8265f40e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:26.349955 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8ab76097-9512-422b-af8f-ba6a8265f40e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:26.352427 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-8ab76097-9512-422b-af8f-ba6a8265f40e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:26.507014 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-8ab76097-9512-422b-af8f-ba6a8265f40e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:26.516662 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-8ab76097-9512-422b-af8f-ba6a8265f40e tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1577 microversion: 2.1 time: 0.181018 May 13 13:36:26.522298 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 567/1157] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:26 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:27.536166 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-56596e89-fa47-43a7-bba6-9a12e6cb764a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:27.536906 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-56596e89-fa47-43a7-bba6-9a12e6cb764a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:27.543259 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56596e89-fa47-43a7-bba6-9a12e6cb764a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:27.543719 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56596e89-fa47-43a7-bba6-9a12e6cb764a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:27.544491 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56596e89-fa47-43a7-bba6-9a12e6cb764a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:27.544935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-56596e89-fa47-43a7-bba6-9a12e6cb764a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:27.683458 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-56596e89-fa47-43a7-bba6-9a12e6cb764a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:27.691301 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-56596e89-fa47-43a7-bba6-9a12e6cb764a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1459 microversion: 2.1 time: 0.159369 May 13 13:36:27.691877 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 591/1158] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:27 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1459 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:28.309894 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-daa654a5-c404-4baa-abea-84dd1150d79b req-c0b3f97c-3889-47dc-9a54-20d1a9b725c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ec7b2f-151a-4074-9dd9-b7a7b0e45c12", "name": "network-vif-deleted", "tag": "acd2f1ab-4dd9-492b-8a9b-447c531381e8"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:36:28.318262 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-daa654a5-c404-4baa-abea-84dd1150d79b req-c0b3f97c-3889-47dc-9a54-20d1a9b725c8 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:28.318710 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-daa654a5-c404-4baa-abea-84dd1150d79b req-c0b3f97c-3889-47dc-9a54-20d1a9b725c8 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:28.330367 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-daa654a5-c404-4baa-abea-84dd1150d79b req-c0b3f97c-3889-47dc-9a54-20d1a9b725c8 service nova] Creating event network-vif-deleted:acd2f1ab-4dd9-492b-8a9b-447c531381e8 for instance 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 on hv-cinder-84159 May 13 13:36:28.335300 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-daa654a5-c404-4baa-abea-84dd1150d79b req-c0b3f97c-3889-47dc-9a54-20d1a9b725c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029651 May 13 13:36:28.335876 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 568/1159] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:36:28.708383 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-192a164a-192d-496c-8dfe-81a13d850461 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:28.709000 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-192a164a-192d-496c-8dfe-81a13d850461 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:28.717256 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-192a164a-192d-496c-8dfe-81a13d850461 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:28.717702 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-192a164a-192d-496c-8dfe-81a13d850461 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:28.718505 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-192a164a-192d-496c-8dfe-81a13d850461 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:28.718944 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-192a164a-192d-496c-8dfe-81a13d850461 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:28.780000 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-192a164a-192d-496c-8dfe-81a13d850461 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:28.787378 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-192a164a-192d-496c-8dfe-81a13d850461 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 200 len: 1226 microversion: 2.1 time: 0.082801 May 13 13:36:28.788230 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 592/1160] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:28 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:29.805026 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c2608d88-4a78-47fe-85a7-75eb3b5b40cb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:29.805736 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-c2608d88-4a78-47fe-85a7-75eb3b5b40cb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:29.812818 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2608d88-4a78-47fe-85a7-75eb3b5b40cb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:29.813281 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2608d88-4a78-47fe-85a7-75eb3b5b40cb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:29.814082 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2608d88-4a78-47fe-85a7-75eb3b5b40cb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:29.814526 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-c2608d88-4a78-47fe-85a7-75eb3b5b40cb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:29.827842 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-c2608d88-4a78-47fe-85a7-75eb3b5b40cb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] HTTP exception thrown: Instance 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 could not be found. May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c2608d88-4a78-47fe-85a7-75eb3b5b40cb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Request method failure captured: May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 HTTP/1.1 May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl0Ldqd3Ptm-EdnlZvTnFjfNDL5CRXv0uvRwNi0XJjxbcN2McQxHJGfsogevDH5Xpt722-Fty6tkZpt8j5wEAIfligjzpBd82XfNZqMIlIcYhxK7eYv3-IzbvPlKxrDN8qpRiM8GczxZ-PSIXIRpk7cwLdzBTPn2onqx--9izh_De4Y May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: d3e32e04d1f44e97b903f98c7c2749db May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-TestVolumeBootPattern-480963567 May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:36:29.829466 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:36:29.831164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3e32e04d1f44e97b903f98c7c2749db", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:29.831164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-TestVolumeBootPattern-480963567 May 13 13:36:29.831164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: d3e32e04d1f44e97b903f98c7c2749db May 13 13:36:29.831164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-TestVolumeBootPattern-480963567 May 13 13:36:29.831164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-TestVolumeBootPattern-480963567-project May 13 13:36:29.831164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:36:29.831164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:36:29.831164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 8101850dd18f4108ac12ff9487cbbe3e May 13 13:36:29.831164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-TestVolumeBootPattern-480963567-project May 13 13:36:29.831164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:36:29.831164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 could not be found. May 13 13:36:29.831164 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': '37ec7b2f-151a-4074-9dd9-b7a7b0e45c12'} May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 could not be found. May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:29.832288 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 could not be found. May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 could not be found. May 13 13:36:29.833909 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:29.835418 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-c2608d88-4a78-47fe-85a7-75eb3b5b40cb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Returning 404 to user: Instance 37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:29.835418 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-c2608d88-4a78-47fe-85a7-75eb3b5b40cb tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12" status: 404 len: 111 microversion: 2.1 time: 0.030591 May 13 13:36:29.835418 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 569/1161] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:29 2022] GET /compute/v2.1/servers/37ec7b2f-151a-4074-9dd9-b7a7b0e45c12 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:36:33.218847 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-58a27714-50cd-4b8a-8f6e-f601b08f2d4a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:33.219562 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-58a27714-50cd-4b8a-8f6e-f601b08f2d4a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:33.222312 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-acfde48b-3ff3-4bd0-9556-11cd7b9a0316 req-ca0b5d5d-fbf7-426e-bfb4-4212014a3243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd189827-5e6a-43de-b4f7-e596ff7c1fe5", "tag": "4d81ea3d-1342-41f8-9505-45e355cea083"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:36:33.225990 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-58a27714-50cd-4b8a-8f6e-f601b08f2d4a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:33.226446 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-58a27714-50cd-4b8a-8f6e-f601b08f2d4a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:33.227353 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-58a27714-50cd-4b8a-8f6e-f601b08f2d4a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:33.227794 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-58a27714-50cd-4b8a-8f6e-f601b08f2d4a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:33.232013 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-acfde48b-3ff3-4bd0-9556-11cd7b9a0316 req-ca0b5d5d-fbf7-426e-bfb4-4212014a3243 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:33.232703 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-acfde48b-3ff3-4bd0-9556-11cd7b9a0316 req-ca0b5d5d-fbf7-426e-bfb4-4212014a3243 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:33.246276 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-acfde48b-3ff3-4bd0-9556-11cd7b9a0316 req-ca0b5d5d-fbf7-426e-bfb4-4212014a3243 service nova] Creating event network-changed:4d81ea3d-1342-41f8-9505-45e355cea083 for instance fd189827-5e6a-43de-b4f7-e596ff7c1fe5 on hv-cinder-84159 May 13 13:36:33.253286 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-58a27714-50cd-4b8a-8f6e-f601b08f2d4a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Going to try to terminate instance {{(pid=117603) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:36:33.254085 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-acfde48b-3ff3-4bd0-9556-11cd7b9a0316 req-ca0b5d5d-fbf7-426e-bfb4-4212014a3243 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035319 May 13 13:36:33.255295 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 570/1162] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:36:33.520704 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-58a27714-50cd-4b8a-8f6e-f601b08f2d4a tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 204 len: 0 microversion: 2.1 time: 0.305186 May 13 13:36:33.521311 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 593/1163] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:36:33 2022] DELETE /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:36:33.530794 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-fdb2ef3d-0e14-470b-9918-3862b83639b0 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:33.534207 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-fdb2ef3d-0e14-470b-9918-3862b83639b0 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:33.538568 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fdb2ef3d-0e14-470b-9918-3862b83639b0 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:33.539031 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fdb2ef3d-0e14-470b-9918-3862b83639b0 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:33.539828 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fdb2ef3d-0e14-470b-9918-3862b83639b0 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:33.540275 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-fdb2ef3d-0e14-470b-9918-3862b83639b0 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:33.676814 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-fdb2ef3d-0e14-470b-9918-3862b83639b0 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:33.684971 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-fdb2ef3d-0e14-470b-9918-3862b83639b0 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1577 microversion: 2.1 time: 0.159351 May 13 13:36:33.685538 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 571/1164] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:33 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:34.702604 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-76d2deba-adbf-419d-ac39-c57dcc54f919 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:34.703311 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-76d2deba-adbf-419d-ac39-c57dcc54f919 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:34.709595 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76d2deba-adbf-419d-ac39-c57dcc54f919 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:34.710093 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76d2deba-adbf-419d-ac39-c57dcc54f919 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:34.710867 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76d2deba-adbf-419d-ac39-c57dcc54f919 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:34.711305 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-76d2deba-adbf-419d-ac39-c57dcc54f919 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:34.863950 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-76d2deba-adbf-419d-ac39-c57dcc54f919 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:34.872445 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-76d2deba-adbf-419d-ac39-c57dcc54f919 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1577 microversion: 2.1 time: 0.173667 May 13 13:36:34.873111 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 594/1165] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:34 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:35.522023 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-f717ab38-800c-4567-838c-6e0450729e5c req-2498adf8-afaa-4d9e-9c7c-bd76b8063a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd189827-5e6a-43de-b4f7-e596ff7c1fe5", "name": "network-vif-deleted", "tag": "4d81ea3d-1342-41f8-9505-45e355cea083"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:36:35.531197 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-f717ab38-800c-4567-838c-6e0450729e5c req-2498adf8-afaa-4d9e-9c7c-bd76b8063a44 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:35.531645 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-f717ab38-800c-4567-838c-6e0450729e5c req-2498adf8-afaa-4d9e-9c7c-bd76b8063a44 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:35.542341 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-f717ab38-800c-4567-838c-6e0450729e5c req-2498adf8-afaa-4d9e-9c7c-bd76b8063a44 service nova] Creating event network-vif-deleted:4d81ea3d-1342-41f8-9505-45e355cea083 for instance fd189827-5e6a-43de-b4f7-e596ff7c1fe5 on hv-cinder-84159 May 13 13:36:35.547340 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-f717ab38-800c-4567-838c-6e0450729e5c req-2498adf8-afaa-4d9e-9c7c-bd76b8063a44 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029180 May 13 13:36:35.547925 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 572/1166] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:36:35.890505 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-37034fb1-f9bf-4956-817d-7cc9ec8db4ac tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:35.891126 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-37034fb1-f9bf-4956-817d-7cc9ec8db4ac tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:35.897825 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37034fb1-f9bf-4956-817d-7cc9ec8db4ac tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:35.898293 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37034fb1-f9bf-4956-817d-7cc9ec8db4ac tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:35.899082 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37034fb1-f9bf-4956-817d-7cc9ec8db4ac tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:35.899726 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-37034fb1-f9bf-4956-817d-7cc9ec8db4ac tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:35.968651 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-37034fb1-f9bf-4956-817d-7cc9ec8db4ac tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8101850dd18f4108ac12ff9487cbbe3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e32e04d1f44e97b903f98c7c2749db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:35.982517 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-37034fb1-f9bf-4956-817d-7cc9ec8db4ac tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 200 len: 1225 microversion: 2.1 time: 0.096358 May 13 13:36:35.984395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 595/1167] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:35 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:37.004886 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-112f510e-bb25-4b86-955e-6c9254788510 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:37.005597 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-112f510e-bb25-4b86-955e-6c9254788510 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: fd189827-5e6a-43de-b4f7-e596ff7c1fe5] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:37.012648 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-112f510e-bb25-4b86-955e-6c9254788510 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:37.013103 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-112f510e-bb25-4b86-955e-6c9254788510 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:37.013904 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-112f510e-bb25-4b86-955e-6c9254788510 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:37.014347 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-112f510e-bb25-4b86-955e-6c9254788510 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:37.027856 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-112f510e-bb25-4b86-955e-6c9254788510 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] HTTP exception thrown: Instance fd189827-5e6a-43de-b4f7-e596ff7c1fe5 could not be found. May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-112f510e-bb25-4b86-955e-6c9254788510 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Request method failure captured: May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 HTTP/1.1 May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl0Ldqd3Ptm-EdnlZvTnFjfNDL5CRXv0uvRwNi0XJjxbcN2McQxHJGfsogevDH5Xpt722-Fty6tkZpt8j5wEAIfligjzpBd82XfNZqMIlIcYhxK7eYv3-IzbvPlKxrDN8qpRiM8GczxZ-PSIXIRpk7cwLdzBTPn2onqx--9izh_De4Y May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: d3e32e04d1f44e97b903f98c7c2749db May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-TestVolumeBootPattern-480963567 May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:36:37.029464 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:36:37.031087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3e32e04d1f44e97b903f98c7c2749db", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:37.031087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-TestVolumeBootPattern-480963567 May 13 13:36:37.031087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: d3e32e04d1f44e97b903f98c7c2749db May 13 13:36:37.031087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-TestVolumeBootPattern-480963567 May 13 13:36:37.031087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-TestVolumeBootPattern-480963567-project May 13 13:36:37.031087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:36:37.031087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:36:37.031087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 8101850dd18f4108ac12ff9487cbbe3e May 13 13:36:37.031087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-TestVolumeBootPattern-480963567-project May 13 13:36:37.031087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:36:37.031087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance fd189827-5e6a-43de-b4f7-e596ff7c1fe5 could not be found. May 13 13:36:37.031087 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': 'fd189827-5e6a-43de-b4f7-e596ff7c1fe5'} May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd189827-5e6a-43de-b4f7-e596ff7c1fe5 could not be found. May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:37.032045 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd189827-5e6a-43de-b4f7-e596ff7c1fe5 could not be found. May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd189827-5e6a-43de-b4f7-e596ff7c1fe5 could not be found. May 13 13:36:37.033578 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:37.035126 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-112f510e-bb25-4b86-955e-6c9254788510 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Returning 404 to user: Instance fd189827-5e6a-43de-b4f7-e596ff7c1fe5 could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:37.035126 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-112f510e-bb25-4b86-955e-6c9254788510 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5" status: 404 len: 111 microversion: 2.1 time: 0.030224 May 13 13:36:37.035126 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 573/1168] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:36 2022] GET /compute/v2.1/servers/fd189827-5e6a-43de-b4f7-e596ff7c1fe5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:36:37.572917 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1e27be34-d515-4ebb-9641-76986f2fa269 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:37.573468 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1e27be34-d515-4ebb-9641-76986f2fa269 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:37.579991 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1e27be34-d515-4ebb-9641-76986f2fa269 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:37.580454 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1e27be34-d515-4ebb-9641-76986f2fa269 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:37.581231 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1e27be34-d515-4ebb-9641-76986f2fa269 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:37.581675 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1e27be34-d515-4ebb-9641-76986f2fa269 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:37.596528 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-1e27be34-d515-4ebb-9641-76986f2fa269 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] HTTP exception thrown: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1e27be34-d515-4ebb-9641-76986f2fa269 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Request method failure captured: May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: DELETE /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c HTTP/1.1 May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABifl0Ldqd3Ptm-EdnlZvTnFjfNDL5CRXv0uvRwNi0XJjxbcN2McQxHJGfsogevDH5Xpt722-Fty6tkZpt8j5wEAIfligjzpBd82XfNZqMIlIcYhxK7eYv3-IzbvPlKxrDN8qpRiM8GczxZ-PSIXIRpk7cwLdzBTPn2onqx--9izh_De4Y May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: d3e32e04d1f44e97b903f98c7c2749db May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-TestVolumeBootPattern-480963567 May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:36:37.598224 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:36:37.599843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3e32e04d1f44e97b903f98c7c2749db", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:37.599843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-TestVolumeBootPattern-480963567 May 13 13:36:37.599843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: d3e32e04d1f44e97b903f98c7c2749db May 13 13:36:37.599843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-TestVolumeBootPattern-480963567 May 13 13:36:37.599843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-TestVolumeBootPattern-480963567-project May 13 13:36:37.599843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:36:37.599843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:36:37.599843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 8101850dd18f4108ac12ff9487cbbe3e May 13 13:36:37.599843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-TestVolumeBootPattern-480963567-project May 13 13:36:37.599843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:36:37.599843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:36:37.599843 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c'} May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:37.600935 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:36:37.602447 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:37.604151 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1e27be34-d515-4ebb-9641-76986f2fa269 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Returning 404 to user: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:37.604151 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1e27be34-d515-4ebb-9641-76986f2fa269 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 404 len: 111 microversion: 2.1 time: 0.030659 May 13 13:36:37.604151 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 596/1169] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:36:37 2022] DELETE /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:36:37.609133 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-77fb978a-2bea-4688-a36a-d0b0025f9aa2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:37.609803 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-77fb978a-2bea-4688-a36a-d0b0025f9aa2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] [instance: ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:37.616092 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-77fb978a-2bea-4688-a36a-d0b0025f9aa2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:37.616572 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-77fb978a-2bea-4688-a36a-d0b0025f9aa2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:37.617375 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-77fb978a-2bea-4688-a36a-d0b0025f9aa2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:37.617863 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-77fb978a-2bea-4688-a36a-d0b0025f9aa2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:37.631019 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.wsgi [None req-77fb978a-2bea-4688-a36a-d0b0025f9aa2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] HTTP exception thrown: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-77fb978a-2bea-4688-a36a-d0b0025f9aa2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Request method failure captured: May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: request: GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c HTTP/1.1 May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept: application/json May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Accept-Encoding: identity May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Connection: close May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Length: 0 May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Content-Type: application/json May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Host: 10.222.0.25 May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Openstack-System-Scope: None May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: User-Agent: python-urllib3/1.26.9 May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Auth-Token: gAAAAABifl0Ldqd3Ptm-EdnlZvTnFjfNDL5CRXv0uvRwNi0XJjxbcN2McQxHJGfsogevDH5Xpt722-Fty6tkZpt8j5wEAIfligjzpBd82XfNZqMIlIcYhxK7eYv3-IzbvPlKxrDN8qpRiM8GczxZ-PSIXIRpk7cwLdzBTPn2onqx--9izh_De4Y May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Id: None May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Domain-Name: None May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Identity-Status: Confirmed May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Is-Admin-Project: True May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Id: default May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Domain-Name: Default May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Id: d3e32e04d1f44e97b903f98c7c2749db May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Project-Name: tempest-TestVolumeBootPattern-480963567 May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Role: reader,member May 13 13:36:37.632563 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Roles: reader,member May 13 13:36:37.634303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_d3e32e04d1f44e97b903f98c7c2749db", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/d3e32e04d1f44e97b903f98c7c2749db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:37.634303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant: tempest-TestVolumeBootPattern-480963567 May 13 13:36:37.634303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Id: d3e32e04d1f44e97b903f98c7c2749db May 13 13:36:37.634303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-Tenant-Name: tempest-TestVolumeBootPattern-480963567 May 13 13:36:37.634303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User: tempest-TestVolumeBootPattern-480963567-project May 13 13:36:37.634303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Id: default May 13 13:36:37.634303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Domain-Name: Default May 13 13:36:37.634303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Id: 8101850dd18f4108ac12ff9487cbbe3e May 13 13:36:37.634303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: X-User-Name: tempest-TestVolumeBootPattern-480963567-project May 13 13:36:37.634303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: method: > May 13 13:36:37.634303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: exception: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:36:37.634303 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: action_args: {'id': 'ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c'} May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:37.635231 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. May 13 13:36:37.636753 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: ERROR nova.api.openstack.wsgi May 13 13:36:37.638234 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-77fb978a-2bea-4688-a36a-d0b0025f9aa2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Returning 404 to user: Instance ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c could not be found. {{(pid=117602) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:36:37.638234 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-77fb978a-2bea-4688-a36a-d0b0025f9aa2 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c" status: 404 len: 111 microversion: 2.1 time: 0.029427 May 13 13:36:37.638234 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 574/1170] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:37 2022] GET /compute/v2.1/servers/ae8ba4c8-0ab5-4c08-8a36-3f2d973b3f3c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:36:39.150685 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-3268108a-abde-4891-947f-7362d86c5fc8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] Calling method '.version_select at 0x7faaa1bdfdc0>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:39.256097 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-3268108a-abde-4891-947f-7362d86c5fc8 tempest-TestVolumeBootPattern-480963567 tempest-TestVolumeBootPattern-480963567-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1357767532" status: 202 len: 0 microversion: 2.1 time: 0.109201 May 13 13:36:39.256710 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 597/1171] 10.222.0.25 () {58 vars in 1262 bytes} [Fri May 13 13:36:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1357767532 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:36:53.673096 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-99fceb17-a5aa-4c10-af35-a066d01e1cc1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:53.673679 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-99fceb17-a5aa-4c10-af35-a066d01e1cc1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:53.681151 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-99fceb17-a5aa-4c10-af35-a066d01e1cc1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:53.681612 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-99fceb17-a5aa-4c10-af35-a066d01e1cc1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:53.682432 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-99fceb17-a5aa-4c10-af35-a066d01e1cc1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:53.682876 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-99fceb17-a5aa-4c10-af35-a066d01e1cc1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:53.708610 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-99fceb17-a5aa-4c10-af35-a066d01e1cc1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Going to try to terminate instance {{(pid=117602) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:36:53.845824 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [req-aa0595fc-c9b6-4f6e-b4b7-ba7b23fa15a2 req-6d5605b0-9de8-44d2-8d1a-2ebe3472539c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69", "tag": "419528c3-a163-4096-aa94-d0e53f8d5d30"}]} {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:36:53.855767 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-aa0595fc-c9b6-4f6e-b4b7-ba7b23fa15a2 req-6d5605b0-9de8-44d2-8d1a-2ebe3472539c service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:53.856218 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [req-aa0595fc-c9b6-4f6e-b4b7-ba7b23fa15a2 req-6d5605b0-9de8-44d2-8d1a-2ebe3472539c service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:53.866583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.compute.server_external_events [req-aa0595fc-c9b6-4f6e-b4b7-ba7b23fa15a2 req-6d5605b0-9de8-44d2-8d1a-2ebe3472539c service nova] Creating event network-changed:419528c3-a163-4096-aa94-d0e53f8d5d30 for instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 on hv-cinder-84159 May 13 13:36:53.872399 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [req-aa0595fc-c9b6-4f6e-b4b7-ba7b23fa15a2 req-6d5605b0-9de8-44d2-8d1a-2ebe3472539c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200924 May 13 13:36:53.873003 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 598/1172] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:36:54.003230 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-99fceb17-a5aa-4c10-af35-a066d01e1cc1 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "DELETE /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 204 len: 0 microversion: 2.1 time: 0.334323 May 13 13:36:54.004020 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 575/1173] 10.222.0.25 () {58 vars in 1238 bytes} [Fri May 13 13:36:53 2022] DELETE /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:36:54.019225 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-a0cde8a4-15c3-4f0f-b550-2f3807dbcb10 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:54.019839 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-a0cde8a4-15c3-4f0f-b550-2f3807dbcb10 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:54.026402 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a0cde8a4-15c3-4f0f-b550-2f3807dbcb10 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:54.026886 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a0cde8a4-15c3-4f0f-b550-2f3807dbcb10 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:54.028495 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a0cde8a4-15c3-4f0f-b550-2f3807dbcb10 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:54.028937 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-a0cde8a4-15c3-4f0f-b550-2f3807dbcb10 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:54.110930 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:36:54.111114 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Fri May 13 13:36:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 (ip 10.222.0.25) !!! May 13 13:36:54.169374 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-a0cde8a4-15c3-4f0f-b550-2f3807dbcb10 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:54.176694 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-a0cde8a4-15c3-4f0f-b550-2f3807dbcb10 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.161861 May 13 13:36:54.177257 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 599/1174] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:54 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:55.196451 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-7cfb45a0-343e-49ea-9c6a-28456a53282d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:55.197296 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-7cfb45a0-343e-49ea-9c6a-28456a53282d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:55.204921 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7cfb45a0-343e-49ea-9c6a-28456a53282d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:55.205568 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7cfb45a0-343e-49ea-9c6a-28456a53282d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:55.211457 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7cfb45a0-343e-49ea-9c6a-28456a53282d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:55.211457 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-7cfb45a0-343e-49ea-9c6a-28456a53282d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:55.420363 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-7cfb45a0-343e-49ea-9c6a-28456a53282d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:55.427808 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-7cfb45a0-343e-49ea-9c6a-28456a53282d tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.236367 May 13 13:36:55.428369 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 576/1175] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:55 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:56.591608 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-59a50a9f-6a7a-44ea-8581-2c38f3cccad7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:56.592259 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-59a50a9f-6a7a-44ea-8581-2c38f3cccad7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:56.598158 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-59a50a9f-6a7a-44ea-8581-2c38f3cccad7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:56.598619 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-59a50a9f-6a7a-44ea-8581-2c38f3cccad7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:56.599428 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-59a50a9f-6a7a-44ea-8581-2c38f3cccad7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:56.599872 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-59a50a9f-6a7a-44ea-8581-2c38f3cccad7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:56.739380 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-59a50a9f-6a7a-44ea-8581-2c38f3cccad7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:56.748641 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-59a50a9f-6a7a-44ea-8581-2c38f3cccad7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1568 microversion: 2.1 time: 0.307974 May 13 13:36:56.749364 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 600/1176] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:56 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1568 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:57.321149 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [req-6d4de949-88df-4d81-a460-9bc6081c3cb7 req-5826725b-2d1f-4e0d-b5c9-87a2d8e1c4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69", "name": "network-vif-deleted", "tag": "419528c3-a163-4096-aa94-d0e53f8d5d30"}]} {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:36:57.329413 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-6d4de949-88df-4d81-a460-9bc6081c3cb7 req-5826725b-2d1f-4e0d-b5c9-87a2d8e1c4f7 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:57.334289 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [req-6d4de949-88df-4d81-a460-9bc6081c3cb7 req-5826725b-2d1f-4e0d-b5c9-87a2d8e1c4f7 service nova] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:57.340858 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.compute.server_external_events [req-6d4de949-88df-4d81-a460-9bc6081c3cb7 req-5826725b-2d1f-4e0d-b5c9-87a2d8e1c4f7 service nova] Creating event network-vif-deleted:419528c3-a163-4096-aa94-d0e53f8d5d30 for instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 on hv-cinder-84159 May 13 13:36:57.345752 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [req-6d4de949-88df-4d81-a460-9bc6081c3cb7 req-5826725b-2d1f-4e0d-b5c9-87a2d8e1c4f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028358 May 13 13:36:57.346338 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 577/1177] 10.222.0.25 () {64 vars in 1317 bytes} [Fri May 13 13:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:36:57.766665 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-1bd900c7-a589-4e40-be02-60f177aff5e7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:57.767287 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-1bd900c7-a589-4e40-be02-60f177aff5e7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:57.773538 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1bd900c7-a589-4e40-be02-60f177aff5e7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:57.779391 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1bd900c7-a589-4e40-be02-60f177aff5e7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:57.779391 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1bd900c7-a589-4e40-be02-60f177aff5e7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:57.779391 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-1bd900c7-a589-4e40-be02-60f177aff5e7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:57.839467 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.policy [None req-1bd900c7-a589-4e40-be02-60f177aff5e7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117603) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:57.847005 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-1bd900c7-a589-4e40-be02-60f177aff5e7 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1219 microversion: 2.1 time: 0.084064 May 13 13:36:57.847543 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 601/1178] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:57 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:58.864980 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-2eaf59fc-cd63-4319-a30b-8a5ff42b7774 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:58.865682 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.compute.api [None req-2eaf59fc-cd63-4319-a30b-8a5ff42b7774 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117602) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:58.872496 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2eaf59fc-cd63-4319-a30b-8a5ff42b7774 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:58.872950 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2eaf59fc-cd63-4319-a30b-8a5ff42b7774 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:58.873718 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2eaf59fc-cd63-4319-a30b-8a5ff42b7774 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:58.874187 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2eaf59fc-cd63-4319-a30b-8a5ff42b7774 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:58.904111 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2eaf59fc-cd63-4319-a30b-8a5ff42b7774 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:58.904555 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG oslo_concurrency.lockutils [None req-2eaf59fc-cd63-4319-a30b-8a5ff42b7774 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117602) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:58.904997 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.objects.instance [None req-2eaf59fc-cd63-4319-a30b-8a5ff42b7774 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lazy-loading 'fault' on Instance uuid b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 {{(pid=117602) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:36:58.947517 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.policy [None req-2eaf59fc-cd63-4319-a30b-8a5ff42b7774 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c6a8bd3014349a3aa60c9471f3c8234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b1cc4c699be4edfa243bc7dde91cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117602) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:36:58.955622 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-2eaf59fc-cd63-4319-a30b-8a5ff42b7774 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 200 len: 1224 microversion: 2.1 time: 0.095430 May 13 13:36:58.956184 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 578/1179] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:58 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:36:59.972395 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-21d9458e-8a52-4058-9cbd-2f8c72e577e9 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '>' {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:36:59.973015 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.compute.api [None req-21d9458e-8a52-4058-9cbd-2f8c72e577e9 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] [instance: b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69] Fetching instance by UUID {{(pid=117603) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:36:59.979124 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-21d9458e-8a52-4058-9cbd-2f8c72e577e9 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:59.979585 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-21d9458e-8a52-4058-9cbd-2f8c72e577e9 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:59.980363 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-21d9458e-8a52-4058-9cbd-2f8c72e577e9 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:36:59.980839 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG oslo_concurrency.lockutils [None req-21d9458e-8a52-4058-9cbd-2f8c72e577e9 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Lock "6cb824f0-0b0e-46be-89c3-2da60fc44ef7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117603) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:36:59.993749 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.wsgi [None req-21d9458e-8a52-4058-9cbd-2f8c72e577e9 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] HTTP exception thrown: Instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 could not be found. May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-21d9458e-8a52-4058-9cbd-2f8c72e577e9 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Request method failure captured: May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: request: GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 HTTP/1.1 May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept: application/json May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Accept-Encoding: identity May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Connection: close May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Length: 0 May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Content-Type: application/json May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Host: 10.222.0.25 May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Openstack-System-Scope: None May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: User-Agent: python-urllib3/1.26.9 May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Auth-Token: gAAAAABifl3D1ZFUZuWuLEsJmbJhMHqbU7cFrOL2vlrh80cskVGPDJHkN65cxkAMSQyZPhti9tc5izKhmFh_3VJsNJ2U8xdSlOF2N0LGsM-KHbECxmu-nG9G0sQJOonmBlewhEqb73fC35VpLPYAtfjV8tHf1idM81tZXKhC6a0jxkuhVnjX278 May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Id: None May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Domain-Name: None May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Identity-Status: Confirmed May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Is-Admin-Project: True May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Id: default May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Domain-Name: Default May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Id: 0b1cc4c699be4edfa243bc7dde91cd51 May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Project-Name: tempest-TestShelveInstance-1347202899 May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Role: reader,member May 13 13:36:59.995423 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Roles: reader,member May 13 13:36:59.997721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b1cc4c699be4edfa243bc7dde91cd51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:8080/v1/AUTH_0b1cc4c699be4edfa243bc7dde91cd51", "adminURL": "http://10.222.0.25:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/0b1cc4c699be4edfa243bc7dde91cd51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/0b1cc4c699be4edfa243bc7dde91cd51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}] May 13 13:36:59.997721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant: tempest-TestShelveInstance-1347202899 May 13 13:36:59.997721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Id: 0b1cc4c699be4edfa243bc7dde91cd51 May 13 13:36:59.997721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-Tenant-Name: tempest-TestShelveInstance-1347202899 May 13 13:36:59.997721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User: tempest-TestShelveInstance-1347202899-project May 13 13:36:59.997721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Id: default May 13 13:36:59.997721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Domain-Name: Default May 13 13:36:59.997721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Id: 9c6a8bd3014349a3aa60c9471f3c8234 May 13 13:36:59.997721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: X-User-Name: tempest-TestShelveInstance-1347202899-project May 13 13:36:59.997721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: method: > May 13 13:36:59.997721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: exception: Instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 could not be found. May 13 13:36:59.997721 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: action_args: {'id': 'b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69'} May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: {{(pid=117603) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 could not be found. May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:36:59.998884 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 could not be found. May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 could not be found. May 13 13:37:00.000513 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: ERROR nova.api.openstack.wsgi May 13 13:37:00.002066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: DEBUG nova.api.openstack.wsgi [None req-21d9458e-8a52-4058-9cbd-2f8c72e577e9 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Returning 404 to user: Instance b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 could not be found. {{(pid=117603) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:37:00.002066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO nova.api.openstack.requestlog [None req-21d9458e-8a52-4058-9cbd-2f8c72e577e9 tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69" status: 404 len: 111 microversion: 2.1 time: 0.028827 May 13 13:37:00.002066 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: [pid: 117603|app: 0|req: 602/1180] 10.222.0.25 () {58 vars in 1235 bytes} [Fri May 13 13:36:59 2022] GET /compute/v2.1/servers/b2e2ce6d-e5f6-41ce-b55e-6dd5d604dd69 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:37:00.233775 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: DEBUG nova.api.openstack.wsgi [None req-55bddb43-c884-4f3f-acbf-c84a59f44f5c tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] Calling method '.version_select at 0x7faaa1fd10d0>' {{(pid=117602) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:37:00.365149 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO nova.api.openstack.requestlog [None req-55bddb43-c884-4f3f-acbf-c84a59f44f5c tempest-TestShelveInstance-1347202899 tempest-TestShelveInstance-1347202899-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2146808143" status: 202 len: 0 microversion: 2.1 time: 0.135839 May 13 13:37:00.365748 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: [pid: 117602|app: 0|req: 579/1181] 10.222.0.25 () {58 vars in 1253 bytes} [Fri May 13 13:37:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2146808143 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:40:14.119419 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:40:14.120074 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Fri May 13 13:40:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:40:32.016035 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:40:32.016725 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Fri May 13 13:40:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:42:00.991798 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:42:00.992366 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Fri May 13 13:42:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:42:04.691764 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:42:04.692368 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Fri May 13 13:42:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:42:13.270054 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:42:13.270712 dv-cinder-841591-2-iscsi devstack@n-api.service[117602]: Fri May 13 13:42:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 13:42:24.440583 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 13:42:24.441177 dv-cinder-841591-2-iscsi devstack@n-api.service[117603]: Fri May 13 13:42:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!